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ABSTRACT 

Individual pupil .scores, school characteristics, and 
characteristics of reading programs vere\^ass€ssed in elementary 
school programs in 36 communities, forming a data bank of information 
on 6,753 students from grades one through six enrolled in special 
reading programs across the country • A series of analyses vere 
performed to determine the school and program characteristics 
associated vith greater reading achievement gains for the 
loves t-achieving students and to assess the stability of these 
relationships, across grade levels. This report discusses the 
construction of the data base, character isitics of the sample, data_, 
analyses, and conclusions. Among the program characteristics that 
appeared frequently in conjunction ttith higher .scores of 
reading-achievement gain vere individual or small group instruction, 
the ase of reading specialists, inservice training of teachers, and 
parental involvement through d'^visory councils. Appendixes provide 
further details of the sample and discuss coding of data and 
analysies. (A A) _ 
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I. INTRODUCTION 

Currently , -local educational funds and national coii5)en8atory 
funds are heavily focused on special reading programs intended to 
improve the reading achievement of elementary students across the 
country. This report examines characteristics of these many different 
reading programs, and is directed toward identifying those character- 
istics which are associated with reading achievement test gains. . Such 
information should be helpful to both educators and policy makers as 
it Increases our understanding of the effects of the allocation of 
resources within the schools for reading programs. 

To date, studies which evaluate reading programs in the elemen- 
tary grades have been, at best, equivocal or confusing in their con- 
clusions (Chall, 1967; Corder, 1971). Accurate estimates of the 
effect of one or more program components on reading achievement have 
not been forthcoming for several reasons including the following: 
the exact nature of the program has rarely been observed, an array 
of different standardized te5^'"liave\ been used as performance meas- 
ures, and analjsesSrSve lacked^ statistical sophistication. Evalua- 
tions often synthesize the results of large numbers of compensatory 
or othar reading programs, using the study as an experimental unit 
and the "mean achievement** of experimental and control groups as 
their data. Few secondary evaluatiors. If any, have attempted to 
recover individual student data in order to obtain a true picture 
of the effect of these programs on groups of children which aiffer 



^8 



In their achievement levels* Hiat is^ often when significant mean diffe 
ences in achieveinent scores are cotspared between programs, one can 
only ponder whether the larger mean gains came mostly from superior 
pupils in one program achieving more, or whether the low-achieving 
students made greater gains, or exactly which groups of students con- 
tributed most to the mean gain* 

To avoid some of these {Problems and to gain more Insight into the 
relationships of achievement gains with school and program character- 
istics for this study, individual pupil*s scores (rather than class 
means) were obtained. Data on descriptive variables cfor each par- 
' ticipating school and their reading programs were also procured* 

r 

f 

These data were obtained from programs in 36 communities and. were 
pooled together, forming a data bank of information on 6,753 students 
from grades 1 through 6 in special reading programs across the country* 
A series of analyses were performed to determine the school and pro- 
gram characteristics associated with greater reading achievement gains 
for the lowest achieving students and the stability of these relation- 
ships, across different grade levels* In addition we examined the 
differences in the reading achievement gains at the lover elementary 
grades conqpared to the upper elementary grades and analyzed the tests 
used to measure these gains «^ These test analyses are important- in '^ -j;./-', 
determining the type of reading which needs to be mastered at the 
different grade levels and in interpreting test results* The test 
analyses and differential gains by grade level are incorporated in 
Voluine II of this report* 




2 



We focused our analyses on the lov achieving readers-*- because 

■% 

they are of the greatest coacem nationally. Our culture 's^conndt- 
jtttat to literacy has Increased partially because, gioup instruction 
In spools depends so heavily on verbal learning* Schools are eager 
to make a substantial in^rovenient in their reading, prolans and they 
need Increased resources to deal with the variety of capabilities In 
their studeiats, and especially they need resources which will be • 
allocated to students who are having difficulties in reading. Such 
Students need to meet success in order to be assured that the effort 
they are asked to expend is worthwhile* And the decision for them 
that it is worthwhile is most lively to come during the eleaentary - 
school years where reading is an in^ortant social goal for the young- 
sters as well* Investigations such as this one, that can suggest a 
sound rationale for the allocation of resources are necessary and 
in^ortant* 



^Tlme and budget constraints did not permit us to do all analyses 
on all groups, but the data are stored on tape and are available for 
further analyses* 
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II. CONSTRUCTING THE DATA BASE 

^^Pre- and post-test -xeadlng achievement data was gathered on students 
from a vide variety of special.. reading programs* Al^o data was collected 
on character Is ticsyt/f" the schools and programs involved which might be 
expected to have contributed Co differences in those achievement scores • 
Correlational relationships between the 'characteristics and- the achieve- 
ment scores led to some hypotheses which are presented in Section IV* 

Locating Studies - ^ • ^ 

A^computer search of ERIC documents since 1970 and a review of the 

Current Index to Journals in Education (CUE) and ■ Dissertation Abstracts 

International were used to identify relevant studies and/or documents* 

Others were obtained from the national and several state offices of 

Title I, ESEA; Title III> ESEA; and the Right-to-Read in addition to 

several obtained through personal! contacts. Altogether» almost 1400 

documents were identified as potential sourc'es for data which would 

meet the. following minimal critetia for inclusion in our project: 

14 a high probability th^t d^^€^iij.ed program- 
coifiponents could be described 

2) pre- and post-testing with a standardized 
achievement test 

3) availability of individual test data 

A) grade level bet^reen and inclnding gradv s - 
1 through 6 



5) po8t'1970 ^ V 
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These docum^ts were read and screened for the criteria of acceptability 
listed al>ove« Many^of the studies located did not meet one or icore of 
the criteriii and the rejection rate was very high. In soir^ cases, it 
Was ii^ossible to discern exactly vhat the "pr'Tsram" or treatment was. 
Many stuWe$ had no pre- and post-testifife and other studies relied on 
pre*- and post- tests that could not be compared across studies; that is, 
they uerfe locally constructed, criferion-referencfed, and/or non-standard 
ized* Some programs were very short term, only a few nonths. In other 
instances^ issues of confidentiality prohibited data contribution to our 
project. After contact was madc-with the original investigators or 
school personnel, 36 studies remained which met our criteria. The^ com- 
rounities which subsequently contributed the necessary data are listed in 
Appendix A/ • ^ / 

-y ■ • . ■ •■ . / 

^ Data Collection 

Information was obtained on three ^levels of variables for each 
individual child in the special programs^: information on school 
characteristics^, program characteristics-^, and 'individual student 
data. ' • 



1 

:3pecial reading program, program, and program under study, all 
refer to the programs implemented in tha individual studies and from 
which we obtained student data. 

2 ' 
School characteristics, school variables, school descriptors, and/ 

or school factors are terms used that refer to those aspects which des- 
cribe the schools ^ere the programs were Implemented.' See Appendix /D 
for a list and Appendix B for the iristt'ument used in eliciting this 
information. 

3 '2^ ' 

Program characteristics, program variabiles, program descriptors, 
and/or program factors are terms which encompass only those asj)ects of 
the program which are different from what would have been found in each 
school if there had. been no program. See Appendices C and E. 



In order to obtain this Information, two questionnaires were 
\ developed (Appendices B & C)* The first elicited information on 
characteristics of the schools ♦ The secon^^^^ used to describe 
the^ special reading program; this Instrument repe^d many of the 
questions from the first, but it referred only to the^'s^^clal pro-, 
graitt^ These Instruments include questions on the number of pupils; 

urban /sbburban population; soclo-Gconomic statuis^ or the pupils; 

\ \ \ 
ethnielty ;-fi^a^r language ^ information -on. teacher__tj:alnlng;_.presence/l 



absence of' teache^v^ii^s , tutors, reading specialists, consultants; 
information on ins true tlMt^^^^ouping, hours of reading instruction, 
method of reporting, 'type of readJftg^^rrogj^, parent groups, pupil 
personnel services, and source and amoimt of^fCfidi^^r^^^ 
were selected because' earlier studies and our discussions led to"^^ 
hypotheses that they >70uld be related to program outcomes* | Also it 
was expected that information on them would be; available on a post-hoc 
basis from most communities* All 36 communities were contacted either 
by phone or with a site visit by a member of our reoearch staff. The 
data collection was thus done on a personal basis to Increase the 
reliability. of the questionnaires. In addition to the information 
requested in the questionnaires, the llason lit eaqh cotmmmity pro- 
vided us with individual data on the students participating in the 
program where it was available: age, grade » length of time In the 
program, pre-test scores and post-test scores , name :x3f test admin- 
istered and dates of testing. 

C 
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The dependent variable, or the measure of program effectiveness 
for all analyp^s in our investigations was the Individual students* 
rav score gains from pre- to post-testing divided by the number of 
months between the. administration of these jtests, or raw score "gains 
per month/' Scores were reported for a variety of tests; and for 
grades -4-6, the ETS Anchor Study *s (1974) t:ables were used to convert 
scores from the various teats into equivalent terms 

For grades 1, 2 and 3^ scores were^ converted to one form and level 
^^or each of the tests usdd* (We eventuality 
grade programs in which the pre-test was a 
ten all this information was assembled » 
of school y progras^^^idjstudent data on 6,753 students from grades 
one through six In thirty-slaT^lf ferent communities across-the 

\ 

country who had participate4 in special reading programs* 

1 i 

Cibstering 

• ' • \r \ 

Having collected the relevant Information for each child, the data 

\\ ^ \\ 
had to be coombined from the So^'site^ in such a ^ay as to include 



dropped thpse few first 
readiness measure*) 
the data bank consisted 



children from a^many sites as possible in a single unit of analysis 
(our ''groups") wfille keeping the variance Inr tHeir scores small 



(Light, & Smith, 1971>. Clustering student^ 



"in^g 
1 by r 



rade level was 

\ • \ 

\ \ 



^The complexity of thiSvtask was \^ncreased by\ tbe^need to convert 
all the various forms of scb^es submitted at\^y\ohe grade level to 



raw scores ,\ to the samr-^test 




^ ^ ,j — an)i the same \t4st\form and 

finally to convert these to the\eqtiivalent Metropo^lt^in score via 
the Anchor sVudy^ Tabbies. Thus asNmiany as\foui^i conversions might be 
necessary for\a giv^n set of score8\\*s See Appendix I fdr tests used. 





V \\ \\ \ 




considered, but the variance In gain scores at each grade level was 
large* Therefore the approach was adopted of forming clusters of low, 
middle, and high achieving students on the basis of reading scores on 
the pretest. Those students scoring within one standard deviation 
of the mean at each grade level were assigned to the middle groups. 
Those scoring at or higher than one standard deviation above the mean 
(84th percentile) were assigned to the high groups, those at or lower 
than one standard .deviation below the mean (ll6th percentile) to low 



groups . 



Conversion tables were not available for cjquating test scores at- 
the lower grade levels, so for grades 1, 2, ahd 3, groups were formed 
containing only students given the same pre-test. thus for these grade 
levels there are low, middle and high groups for each different test 
administered. Cutoff points used for each test in forming the clusters 
are shown in , Appendix F, Table 1. Since test Is cores for all students 



at the 4th, 5th and 6th grade levels had been converted to eqiiivalents 



of the HAT, all students with total reading scores in these grades 
pould be clustered into one of three groups for each grade level. 
See Appendix F, Table 2, for sanple size, means; and standard 
deviations of the 4th, 5th and 6th grade groups. )\ For the middle 
groups in general, the mean scores tended to be lower than the 50th 
percentile (they are actually low-middle grpups), and their variance 
is greater than that for the high or low groups. ^ 



is 



This clustering procedure yielded 39 different groups with a total 
of 6,242 students^. A third of these groups contained students from 
seven or more sites; but one half of 11 groups had three or fewer 
sites. Some of these groups were made up of children who had compre-^ 

henslon scores only; but twenty-four were groups on which total reading 

I 

scores were available. The means and standard deviation of the gain' 

2 i 
scores per month ^or these 24 are presented in Table 1. - j 

i 

f - 

3 



The sample of 6,753 was reduced to 6,242 by this, clixsterlng 
procedure as several groups created were too small to warrant analysis. 
Further, group 1 was deleted: its pretest score on the Metropolitan 
Readiness Test could not be converted. Group 28 was dropped for a 
combination of reasons: small N (52 con^ared to 125 and 151 for the 
other "high" groups) and the fact that we were not concentrating our 
efforts on high achievers. Consequently, data on 6,141 students in 
37 groups creaCed by clustering were analyzed. 

^These raw score data should not be compared across grade levels^. 
Different levels of the MAT are used at each grade level and the gains 
in raw scores on one level relate differently to grade equivalents than 
do gains on another level. For example, a gain of 12 points at the 
middle of second grade on the Elementary level MAT is equal to a gain of 
1.6 graide equivalents while a gain of 12 points on the Intermediate 
Level MAT is equal to a gain of 1.2 grade equivalents. It should also 
be pQlnted out that a given raw score gain represents considerably 
dif fereJttt;>growth, in terms of the norms, according to whether those 
points; are at the bottom, middle, or top of the scale. For instance, 
a gain of 12 raw score points in grade 5 on the Intermecjiate Level of 
the M^T represents growth of 2.5 grade levels at the very bottom' of 
the Scal2, .9 grade levels in the mid range, and .8 at the very top. 
Additional differences also result at grades 1, 2, and 3 because 
different tests were used. 

16 
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TABLE 1 
GAIN SCORES 

Means (X) and Standard Deviation (SD) of Raw Score Gains Per Month 
on Total Reading Scores^ for the I.ow~, Mid-, and High-Groups at each Grade Level 



Low Group 



X 



SD 



Mid Group 
X SD 



High Group 



SD 



Grade 2 






MAT 


3.259 


1.852 


GMT 


3.476 


1.653 


SAT 


3.6689 


1.8182 


CAT 






Grade 3 

o 






MAT 


1.8566 


1.2131 


GMT 


3.4211 


1.6909 


SAT 


3.1060' 


1.6696 


' CAT 






Grade 4 






MAT 


2.9817 


1.9905 


Grade 5 




<• 


MAT 


1.4436 


1.4446 


Grade 6 






MAT 


1.4645 


1.1861 



VP 



3.3369 
* 2.555 
2.4408 
2.9787 

1.768A 
2.1093 

2.1285 



1.7477 



\ 



1.1927 



1.1564 



l-.65'69 
L.661 
1.3793 
1.4067 

/ 

1.1618 
1.7532 

1.3956 

1.3773 

1.1964 

1.0971 



.5295 



.3421 



.0103 



.7600. 



1.8427 1.4473 



.9653 .8410 



,7734 



.5696 



Where differant tests were used and could not be converted, separate entries are 
made. Grafi^ 4, 5, and 6 statistics are reported for MAT converted scores. 
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III. CHARACTERISTICS OF THE SAMPLE 

This section gives a general overview of'the^characteristlcs of 
our sample and the trends suggested by the co-occurrence of certain 
characteristics and/or the lack of variance for other characteristics. 

Then the latter part Is devoted to a delineation of those variables 
generally associated with the lower achieving groups. 

^' - General Description of the Total Saii5>le \^ 

As mentioned above ^ pur data were collected from sit^s across the 
country. They Include a diverse set of localities in many respects, 
SO that although the sample was not randomly drawn and is not statis- 
tically representative of the nation's reading programs, it \does Include 
a wide range of programs serving a broad selection of communities. 

Thirteen of the sites were in urban districts, five were small rural 
districts, eight were smaller cities or towns and ten were suburbs of 
larger cities. About eleven sites were from the northeast, seven in the 
midwest and the remainder were spread fairly evenly across the southeast, 
southwest, and northwest. Half of the large urban districts were eastern, 
three western, and thiree others from the midwest; the rural districts 
tended to be in the west with a" few exceptions. 

Inl;eneral, the SES level was somewhat below average as half of 
the sites reported the presence of "low" SES children and an additional 
ten reported the presence of "low-middle" SES students. Only seven re- 
ported children in the "middle" range and one Isolated case of "high" 

' '' ' , \ 

11 18 



was reported. All of the 36 sites were in districts receiving Title I 
funds, and sevex^teen of the programs were ftmded entirely by Title I, 
wh^le another fi|^^e were supported by Title III money. Ten programs 
were supp^orted by their own school funds and five others were funded v 



by a combination of sources. 

\ ^ 

The per pupill expenditures for the districts ranged from a low of 

\ ■ \ \ 

$400j499 to a\hi'gl| of over $1000 with more than half spending more 
than $1000 per pupil per year. 

Enrollments included the following ethnic groups: American Indian 
Black, White, Chicano, Puerto Rican, French, Polish, and Portuguese. 
English was the first language of 90% or more of the students in most 
sites with only 6 sites having a significant number of English-as-a- 
second language students* 

The programs themselves varied considerably. IVenty-three of them 
.were supplemental programs providing instruction which was in addition 
to the regular classroom reading lessons. Nineteen of these 23 and 
four additional were "pull-out programs," tfi^t is, participating 
students left their respective clakg^o^ and received their special 
program instruction in a separate plafce. The remainder were given 
additional help within their classroom setting. ^ , 

The time devoted to these programs also varied considerably from 
about 1 1/2 hours per week at three sites to 10 hours per week at two 
sites, but the majority ranged from 2 to 7 hours per week. 

The lack of any variance for several of the variablets we had • 
collected data on suggested several trends, at least for ourtsltes. 
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All sites had "developmental** or regular, reading instruction for all 
grades 1 through 6 and most schools had parent groups at all grade 
levels as well. Another trend noticeable in our data^was the fact 
that special programs which provided medical services Co children 
often also provided ^guidance and/or social workers for children and 
their parents. 



•4 
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Characteristics of the Low Achieving Groups 

Within the overall sample described above » analyses were focused on 
the low achieving groups. The school characteristics of these groups 
differed from the high achieving groups and we describe chese differences 
below In a comparative manner.^ It Is Important to note that the dlff- 
erences refer to the communities In our study only and they refer only ' 
to comparisons made between the characteristics more or less prevalent 
for the low groups as they are compared to the high groups. Many des- 
crlbe the situation as we would expect and none,<?^ be Interpreted as ^ 
causal; they describe co-occurlng events. Data for the comparative 
statements made below came from the programs already underway, where 
school personnel were already aware of the reading problem and working 
on It. Therefore, -In Interpreting the statements the reader should 
realize they may well reflect the Input* of ^special programs and this Is 
a strong reason to caution again against Inferring causality. ' 



The percent of low group students for whom each school character- 
istic was present was compared with the percent of high group students 
for whom It was present. If these percentages differed by 15% or more, 
the low-^jt^oup was considered to be different from the high group In that 
respect ^^and Is so described In statements 1 through 11. For example, 
at gradei 2 the analysis for- the variable concerned with teacher par- 
ticipation In curriculum development was assessed as follows and reported 
as a characteristic less apt to be found for teachers of the low groups 
because the percentage difference (50% and 78%) Is greater than 15%. 





Total number 
of students 


Number of students whose 
teachers participated in 
curriculum development 


Z of students whose 

teachers participated 

in curriculum development 


Low Group 


• 453 


226 


50X 


High Group 


241 


188 : 


78% 






14 

21 





1, Schools with a larger percentage of our low groups tended to serve 
larger nunbers of children, located in an urban area whose per pupil 
expenditures were smaller than for schools serving a larger percen- 
tage of the hi^ groups* A lower socio-economic status also char- 
acterized the low groups* 

2* Ethnicity - There are differences across grade levels, but most 
often the low groups were characterized as having fewer white 
students than the high groups* 

V • ' 

3* Grouping for instruction - Low groups were more apt to be homo- 
{^eneously grouped and more often their classrooms were graded as 
opposed to the high groups* 

4. Schools serving the low groups rrades 4-6 were less apt to liave 
teacher training , and nhe teachers were less apt to be involved in 
curriculum development for grades II, 3, and 5* 

5. There were more teacher aides in grade 2 in schools serving a larger 
percentage of low groups, but fewer in grades 3 through 6 * There 
were more tutors in grades 2, 3, and 4 than for the high groups, 
but fewer in grades 5 and 6 * 

6* There were more reading specialists ig^^grades 2 through 4 , but 

fewer in grade 5 in schools serviu^.the^lmi^groups. There were . 
^ fewer outside cons u ltants at all gra<ie lejffe^s* 

7* Hours of reading instruction - The low groups cemc from schools 
where there were apt to be fewer hours of reoding instruction in 
grades 3 and 6 , but more hours in grade 2 than the high groups. 

8* Remedial reading program^ - The^ lev f^roups came from schools where 
there were fewer remedial reading programs in grades 2. 3> and 4 
but more in grades 5 and 6 * 

9* Enrichment activities^ - The lew groups came ^rom schools where 
there were more enrichment activities in grades 2, 3 and 4 than 
for schools from which the high groups caTue* However, in grades 
5 and 6 there were fewer enrichment activities i n schools serving 
the low groups* 



^Remedial reading programs refer to special instructional programs 
designed for students who are reading far below grade level. 

2. Enrichment activities include such offerings as trips to museums 
or cultural centers, dramatic productions, ''field" rather than school 
related activities, etc* 
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10« Psycacloglsts for parents'- Schools serving the low groups tended 
to have tnore psychologists working with parents of children than 
those serving the high groiq)s In grades 2> 3, and 4 but fever for 
parents ^vlth children in grades 5 and 6 * This i&eans that for the 
iq)per grades the parents of children in the higher groups were 
more likely to have access to a psycholgist than the parent-^ of 
the low group* % 

11« Social worker for parents - Schools serving the low groins had 
more social workers for parents with children in grades 2> 3t 
and 4 than schools containing the high groups* However » similar 
to the psychologists 9 there were fewer social workers for parents 
of low children in grades 5 and 6 than for the high groups ♦ Social 
workers for the children themselves were more aj>t to be available 
for the low groups conqpared to the high groups* 

Some other generalizations can be drawn about the low groups without 
comparing them to the high groups* A selected set of their character- 
istics are given in Table 2 and it may be noted that various ethnic 
groups and degrees of urbanicity were represented* The data also indi- 
cated that more special services were available to the low groups in the 
lower grades: tutors, teacher aides, reading specialists, enrichment 
activities, psychologists and social workers; and yet there were^more 
remedial reading programs in grades 5 and 6. 

These few general statements are Intended to give a flavor for the 
composition of the low groups as^well as to describe the situations in 
which the low groups were more often found* 



23 



16 



TABLE 2 



GROUP CHARACTERISTICS 



Characteristics 


6 


9 


12 


16 


20 


22 


27 


32 




Grade 


2 


2 


2 


3 


3 


3 


4 


5 


6 


Number of Students* 


80 189 184 136 252 156 


430 295 243 


* Number of Sites 


6 


9 c- 


3 


7 


8 


3 


19 


19 


12 


Ethnicity** 


• 


















Indian 




+ 






+ 






4. 


+ 


Black 




+ 










+ 


+ 


+ 


' White 


+ 


+ 


+ 


+ 


+ 


+ 


+ 


+ . 


+ 


Spanish 


•I- 




+ 


+ 


+ 


+ 


+ 


+ 


+ 


O.ther 


+ 


+ 




+ 


+ 




+ 


+ 


+ 


' School District** 




















Urban 

•< 


+ 


+ 




4- 


+ 




+ 


+ 


+ 


Rural 








+ 


+ 


+ 


+ 


+ 




Suburban 


+ 


+ 


+ 


+ 


+ 


+ 


+ 


+ 


+ . 


Average Age (vrs.) 


7.5 

n=44 


7.4 

n=86 


8.2 

n=38 


8.7 8.7 

n=108 rt»13 


7.9 
n-7 


9.6 

n»302 


10.4 

-n=172 


11.7 

n.»126 


Pre-Test jBrade/ 
Equl.yilent ' 


1.5 


1.3 


1.4 


1.9 


1.6 


1.8 


1.9 


2.6 


3.2 


on whic'i Test 


MAT 


GMT 


SAT 


MAT 


GMT 


SAT 


all 
MAT 


converted to 
MAT MAT 


.Mean gains per 
month (raw score) 


■3.17 


3.17 


3.67 


1.83 


3.28 


3.11 2.94 


1.44 


1.55 


Standard Deviation 


1.8 


1.7 


1.8 


1.2 


1.7 


1.7 


1.9 


1.1 


1.2 



•*Thc number of students decreases somewhat in the regression analysis due to 
missing data on some students* ^ 

**A "+'• in any on; of these rows indicates ^that the particular ethniC'>..group 
. ^ (or Urbanicity) was represented in the group indicated at the head of the column* 

Q For instance, the complete row of marks for ••suburban*" indicates that all 
EHJ^C groups had some suburban representation.^.. 



IV. DATA ANALYSIS 

llie main foctia of the study was to determine if tUare are school 
and/or program characteristics which are associated with greater 
achievement gains particularly for the lowest achieving students • 
Different levels of analysis were utilized to investigate certain"" 
questions with regatd to these relationships: simple correlationq, 
multiple regression analysis » partial correlations ^ and anal^^sis'^of 



variance* The sections below discuss first the statistical techniques 



used to address specific questions posed and subsequently the results 
*of the analyses and interpretations « 

Questions and Analyses 

The question central to the entire study was '^t'hat significant 

relationships are found between school, ^program, or individual student 

characteristics and achievement gains?** Pearsonian correlations were 

1 

computed for all ordinal variables separately for the lowr, mld-» and 
high-groups at each grade level to answer^ this question fez those 
variables. Correlations were also computed on the transformed nominal^ 



The ordinal level of measurement is achieved whin the values for 
the variable can be rank*-ordered according to some criterion* Many of 
our variables were not ordinal and for them, time and budget constraints 
'permitted us to make analyses for the low«-groups' only. 

^Nominal variables — those for which the values are names only and 
no assumptions can be made about ordering — ^had to be transformed prior to 
analysis. Appendix G. should be read by those interested in the pro- 
cedures for transforming variables. (At this point in the analysis 
certain other variables about which we had misgivings were dropped. For 
instanc^T^our contacts with people at program sites °led us to believe 
that they were reluctant to respond with any one answer to the question 
on program enqphasis, and that responses to questions on curriculum ^ 
development were less than reliable due to the way in which these ques- 
tions were worded.) 



and dichotomous, variabler for the low groups only* 

Further we wanted to know '*how consistent ^are these relationships 
across grade levels and for students fro^ different achievement gcoups?" - 
The correlations on the ordinal variables would respond to both grade 
level and achievement level groups; wrfile for the nominal and dicBotomous 
variables we would have to confine the responses to the low achieving 
group » but could compare across gfade levels* 

\^Our next question concerned the manner' in which variables acted in 
combination in accounting /for variance* "How much of the vari^aice in 
gain scores for the low groups ban be ^accounted for by a. combination of ^ 
the variables studied?" Sid>sequently > multiple regression analyses were 
undertaken Entering SES and ETHNICITY first in order to determine the 
total contribution of selected program variables to achievement gains 
after controlling for these .two influential factors over which educators 
have no control* Through multiple regression one can control for the 
variance associated with a set of characteristics one ^ at a time and 
examine their total relationship to the gain scqres* 

Then one also wants to know the relative strengths of the individual 

* * * 0 

variables for the low groups* "After SES and ETHNICITY have been account- 
ed for, hov much of the remaining variance in gain scores can be accounted 
for by individual program characteristics^" And "What hypotheses are 
suggested cdhceming the effectiveness of certain relevant program char- 
acteristi>i8?" The multicollinearity ofithe variables was considerable* 
That is, there were strong relationships among other characteristics, 

o 

26 

19 



and between them and SES and ETHNICITY as well. Therefore, it was 



ne 



lecessary to look at partial correlations, having first removed the 
variance In" gain scores associated with SES and ETHNICITY. These 
partial correlations indicated the relevant additional contribution to 
the variance associated with each program variable, variables which 
might come under the control of educators and policy riakers. To further 
suggest hypotheses concerning those variables that did contribute sig- 
nificantly, an informal inspection of the mean gain scores of valuer 
within jeach variable was undertaken. For example, with analyses of 
variance, it could be determined if, for the variable SOURCE OF INSTRUCTION 
for the different grades, there was a significant difference in the 
mean gain scores for those children who were in a program (1) run by 
their regular teachers, (2) by reading specialists, (3) by tutors, (A) by 
machines, (5) by teachers and specialists, (6) by tutors and specialists 
and^(7) by teachers and m^^hlnes^, etc. Given the differences w^re sig- 
nificant, an inspection of the means for each of these values to discover 
r 

patterns of differences could then lead directly to an hypothesis con- 
cerning the ef fectlvenesbv-of a given source of instruction for low- ^ 
achieving students. * ^ - 



* \ 
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Results 



Correlations/ 




To date, most of the correlational data from other studies presents 

" ^ \ \\' 

data on groups of students who have a wide range of abilities *4nd achiever 

ment and the inference is drawn that the correlations found acro^ this\ 

wide range holds for the poorer students. Often such studies contl 




statistically for abiUty. Our approach has been different. We wer4^\^ 

\\ ^ 

interested in whether or not school and/or program characteristics were\\ 

\\ 

associated with the gains made by students at different achievement 
levels,, when special attention is given to the reading program. There- 
fore our analyses were on groups of relatively homogeneous students and 
any significant correlations were noted for particular groups: high-, 
mid-, or low-, and for* specific grade levels one through six. 

There is another important difference in. the correlations found in 
this study compared to many others: our question was, "What is associated 
with the change in achievement scores between time x and time y when 
students are in special reading programs?" rather than the usual question, 
J'Wh^t is associated with achievement at time x?" The search is for 
cimracte^isti^ associated with gain scores, not for those associated ' 
with higher polt^-test scores. Our approach is Important, we believe, 
because any correlations consistently found particularly for low- 
achieving students <)annot be ignored by persons concerned with funding 
programs nor by 'educators attempting to improve the reading of low- 
achievers . 




with 10% or more of the\varlance in gain scores are presented in Ta^le 



As described in\the previous section, correlations were perfprmed 
on chree types of variables: ordinal, ^transformed nominal, and d^cho- 

tomous. Correlations \ov all groups on the ordinal variables associated 

\ 
\ 

\ 

3 and an overview of thesV findings along with some generalizations 
which can be made from simi»le correlational analysis alone follow. 
Comparisons of three levels V>fj achievement groups can be made in this 

\ s 

analysis only as no further analyses were computed on the mid- and high- 
groups. Table 4 then presents the correlations for thfe ordinal, trans- 

I \ 

formed nominal and dichotomoits vdjriables for the low groups only. 
- Ordinal Variables for all, Groups . 
No one of the characteristics presented in Table 3 consistently 

s . ^ 

accounted for 10% or more off the varia^jce in gain scores for most 
groups. There were considerkble differences in the correlations for 
\(1) the various grade levels; and <2) the various groups (high-, mid-, 

or low-). No school or program variables w\re equally iin)ortant to all- 

\ ' • ' \ 

children in all grades. However, let us cons:^der the correlations for 

* . . - -\ ' 

several of these variables to determine if any generalizations can be 

: \ 

\ 



made . 

\ 



\ 



22 

28 



TABLE 3 



0 



CORRELATIONS OF INDEPENDENT VARIABLES WITH GAIN SCORES 
Correlations for Ordinal Variables Associated with 10 percent or More 
of the Variance In the Gain Scores per Month 















2 










3 


Group Nutuhcr 


2 


3 






6 




8 


9 


10 


12 


13 


lit 


15 


16 


17 


18 


20 


21 


22 




-ii 


Low, Hi^cno. High 


tllp.ii 


Mid 




Mid 


Low 


iiir.li 


n\t\ 


IX)W 


Mid 


Low 


High 


Mid 


MM 


Ijow 


High 


Mid 


Low 


md 


Low 


Low 


Iticj 


Ntimbor of Sites 


it 


(t 


2 




6 


it 


6 


9 


9' 


3 


2 


3 


2 


7 


5 


7 


8 


8 


3 


1 


' 2 


Numlior of Stitdont*: 


263 


7S 




39 


80 


67 


275 


189 


103 


184 


174 


223 


41 


136 


86 


315 


252 




156 


86 


36 


School V.irlablcs 

Size ^ 




.SO 




J. 6 9 


















-.57 


















Socio-economic st.itus 




















-.57 






.41 






.31 






-.33 




.38 


Clans size' 


* 


* 


* 


IT' 












.61 


* 


* 


-.41 
















.38 


Hour;; of rending Instruction 












.42 








.54 


* 




.37 












.41 






Per pupil expense 




* .36 




'.Zo' 












M 






.Itl 


-.32 










.43 




.42 


Program or Trcatnwnt Variable 
Socio-economic status 










i 










-.57^ 






.41 












-.33 




.38 


Hours I of re.idin^ 












.33 




-.37 




-.54 








-.31 




-.48 






-.42 




* 


Hours ' In **otlnji" treatinciU 


* 






* 




33^^ 




'I' 


—35 — 








* 


* 


* 


* 


* 


* 






* 


Iniiiviauil's Data 




.38^ 








































l/*hgth| of progr.iD 


-.30 


-.34* 




* 




.46 






-.34 


* 






* 










-.44 


* 




* 



N*Tliere was no vari.nnce In the v.nri.nblc^ 



for the^e groups 



TABLE 3 (continued) 



CORRELATIONS OF INDEPENDENT VARIABLES WITH GAIN SCORES 
Correlations or Ordinal Variables Associated with 10 percent or Ifore 
of the Variance in the Gain Scores per Month 



Grade 


4 


5 


6 . 


Group N«iniior 


25 


26 


27 


7.8 




30 


31 


32 


33 


16 


35 


36 


37 


38 


39 


low. MItMlc. High 




Mid 




Hlgl 


Iflc 


Low 


Mid 


Low 


High 


Mid 


lx>w 


Mid 


Ix>w 


Mid 


H(r.h 


Number of Sites 

— — ZX^ 


2 


2 


19 


19 


18 


2 


2 


19 


6 


16 


2 


3 


12 


6 


12 ^: 


Wiimber of Students • 


85 






52 


302 


57 


73 


295 


106 


337 


60 


80 


250 


125 


601 


School Vnrlnbles 
Size 


.32 


.36 








.32 




















Socio-economic status 
































cidsr* size 
































Hours of rrndinf* Instruction 


.60 


M 








.61 


.52 








.53 ' 


.67 








Per pupil expense 




.32 




* 




.33 










.60 










y rroj;r.im or Trentmcnt Variable 
































i>oc I o -economic «itntus 














% Hours of r^ndinf.^. 


















.60 










.36 




A Hours In "ocf>t*r** treatment 
















-.52 














\ ^ 

Tmllvlilual's Data 
































f4£ngth of progr,im 


-:5^ 


-.77 








-.67 


-.60 








-.37 


-.62 


-.38 







\ s 

Utere was no variance In the variables for t^lic^a* groiip*^. 



(1) SOCIO-ECONOMIC STATUS . Coding for the SES variable is pre- 
sented in Appendix H and the majority of the programs were categorized 
In the three lowest values of the ten possible. Because of the cliar- 
acter of the low-achieving groups (all children scored one standard 
deviation below the mean on the pre-test), the question answered by our 
correlational data for low groups Is more properly — "How predlctj:ve 
Is a general estimate of the socio-economic status of a gro^i^of low- 
achieving children to the gains they will make In a special reading 

r 

program?" This seems to us to be a very li!q)ortan toques t ion • If all 
correlations had been large and positive^ one would have to question 
the usefulness of programs for low-achieving children from low SES back-* 
grounds. It would be difficult to find additional variance associated 
with .program characteristics; However, the negative correlations found 

for two of the low-groups are encouraging. These negative correlations 

< 

occurred when a considerable number of low SES students made greater 
gains. And evidence that such situations did ex^bst indicates the pos- 
sibility that effective programs can be planned for lower SES students. 

In seeming contradiction, for three mid-groups, a higher SES was 
associated with greater gain scores yielding a positive correlation. 
TWo of these are at third grade level. One might conjecture that changes 
to more^^ literate language in the tests at about this level (see Volume II) 
contributed to this strong association. While we cannot attribute 
"cause" in these correlations, further investigation should be under- 
taken to determine if there is a causal relationship. That is, are 

25 34 ^ 



the mid-group students who are beginning to face reading materials 
that contain a more literate or "bookish" vocabulary at an advantage 
if they come from a higher socio-economic environment? If so, why? 
Are there more books in tl\e home? Are the children read ^o more 
frequently? Are their classrooms better equipped with materials for 
gaining knowledge? All of the above? 

. The instability of the correlations is evidence that other more 
powerful factors wei^e at work* The rather limited variance in our 
narrowly construed groups was sometimes positively associated with SES 
and sometimes negatively. They prompt us 'to hypothesize that it is 
possible for students from low SES backgrounds to achieve higher gain 
stbves on reading ach i eveme n t * 

(2) PER PUPIL EXPEMDITURES . At -the first grade level, higher, per 

pupil expenditure was associated with higher gains for the high- and r 

r 

mid-groups; whereas for the other grades, these diffetrences were more 
apt to be app^Nrent for the mid- and low-groups only. For two low- 
groups, the correlation was negative (one at second grade-group 6, and, 
one at third grade-group 16) and one cen only conclude that some pro- 
grams underway in schools where the per-pupil cost was low were effec- 
tive* Since'^we could obtain no comparable data on the costs of the pro- 
grams themselves (because of the number of various ways used by the school 
to compute such costs), we can only conjecture that in seme instances 
program expenses may have counterbalanced low-school per pupil costs* 
^^^at is, it is possible that: high-program costs occurred where effective 
progi ims existed in otherwise low-budget schools. It is beyond the 

35 
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limits of our data to test that suggestion, but we can say that for a 
third of the low- and mid-groups in grades 1-6 taore than lOZ of the 
variance in gain scores is positively associated with higher per pi^il 
costs* " . 0 

(3) LENGTH OF PROGRAM * Across many grade levels, the length of the 
program under study (mostly within a relatively narrow range of 6 to 10 
months) yielded negative' correlations* The short progtams predicted 
greater gains-per-month on standardized tests administered before and 
after the program than the longer programs* The rate of gains per month 
achieved in the first six months or so of a program seem to have been 
difficult to maintain over a longer period* Therefore, the longer a 
program continued, the more diluted a gains -per-month average was* Also 
it is possible that successful students were exposed to special programs 
fjSir a shorter period because they met with success* This would have 

V 

affected the correlation also* No conclusions can be drawn, however, 
for long term programs '(i*e*, over several years) because only one of 
our sites provided longitudinal data* 

(4) HOURS OF REGULAR CLASSROOM READING INSTRUCTION * There were more 
high positive correlations for t^^is variable that for any other variable 

^it should be emphasized that, special programs notwithstanding^ the 
inqportance of time and attention in the reular reading programs is 
associated with ga^n s^tores and that when students spend time "reading" 
in class, one can predict that their reading achievement will be greater 
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Ordinal. Nominal, and Dlchotomous Variables for Low Groups 
Becaase correlations on the nominal variables across all groups were 
not computed, one cannot draw conclusicns about these characteristics 
for the mid- and high-groups. However, one can inspect the correlations 
for the low-groups to see if any significant relationships are consistent 

across grade levels. 

The correlations in fkble 4 suggest that many of the program charac- 
ter is tics we re indeed significantly correlated with gain scores at many 
grade levels for these low groups. As further discussed below, the 
multiple regressj.. analyses and the partial correlations indicated that 
the multicollinearity of the data (the inter-relatedness of the character- 
istics) made it impossible to sort out differences in the strength of the 
relationships. It will also be revealed in the discussion of the analyses 
of. variance that while particular bharacteristics maintained significant 
relationships ..that significance may well be attributed to different com- 
parisons being made within those characteristics for each group. We will 
discuss this further when we -examine the association of each character- 
istic, but it should be noted here that the consistently high correlations 
^or nominal variables (Table 4) have not necessarily indicated that the 
relationship was the same for each group. ^ 

The correlations in rims' 4 were useful in selecting strong variables 
^ for the multiple regression. 



^Different contrasts between the values on the transformed variables 
were used to maxi-nize correlations and they are not always comparable 
from one group to the other. 
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TABLE 4 












/ 


Significant Correlations of Variables vith Gain Scores 
Per Month for the Low Groups 


r 






'/ " 

Group 


16 


19 


112 116 


120 


922 


#27 


132 


#37 


Variables 


/ U 


1U7 


164 130 




1 Aft 


408 


302 


196 


SES (6) 






-.572*** 


,265*** 


-.344*** 


.100* 


.246*** 


-.189** 


^ Ethnicity (H) 




.ill* 


.401*** .430*** 


. 341*** 


.453*** 


. 343*** 


.310*** 


.453*** 


Size of Instructional Group (N) 




.602*** 


.609*** 


,^27*** 


.453*** 


,261*** 


.375*** 


.303*** 


Hours of Reading in Program (0) 




-.505*** 


-.536*** -.350*** 




-.453*** 




«189*** 




Source of Instruction (N) 




.461*** 


.611*** .629**^ 


.238*** 


.453*** 


.286** 


.318*** 


.347*** 


Location of Instruction (N) 




.A38*** 


,350*** 






.333*** 


.342*** 




1 

Teacher Training (N) 




.AAl*** 


,576*** 


.211** 




.270*** 


, 348*** 


.376** 


^ Parent Groups (H) 




.550*** 


.631*** 


.419*** 




^309*** 


.375*** 


.199* 


? Type of Tutors (N) 






.401*** .216* 


.372*** 


.439*** 


.309*** 


.340*** 




Social /Guidance I'orkers for Ss (L) 








,286**-^ 




.322*** 


.243*** 


.198**/ ; 


f Reading Specialists (N) 


.253*' 


^ .60A*** 


.401*** .431*** 




.435*** 








1 Selection of Students (N) 




.471*** 


.611*** 




.435*** 


.275*** 


.290*** 


.181* 


Bevelopziental Reading Program (D) 




.392*** 


,350*** 


,28o*** 


• 








Renedial Reading Program (N) 




.392*** 


,350*** 


.286*** 






.193*** 


* 


^ Enrichment Program (N) 






,350*** 






.234*** 




V 


Hours in "Other' than Reading Prgn'*(N) 




,350*** 


,286*** 






,114* 




Decoding Skills (N*) 




.31A*** 


,350*** 






wl64*** 


.233*** 




Writing Skills (U) 






.350*** ,221* 




.445*** 




.141* 


.220** 


language Arts (N) 






.350*** 604*** 








.352*** 


,262*** 


Speed Reading (B) 




. 300** 




.128* 


) 


,X69*** 


.118* " 




^ Consultant's Role (N) 


1 


,580*** 


,401*** .607*** 


,406*** 


.435*** 


.332*** 


. 384*** 


199* 


School Funding (per pupil 
expenses) (0) 


-,332*** 




,543*** -.321*** 




.434*** 






o 


Program Added to regular 
Instruction (0) 


-.289** 


-.317*** 








-.121** 






Total Hours of. Reading (0) 


.22A* 




^ 


V 




• 




> 



*p ,05 
**p'^ .01 
**^ .001 



This N rt^presentj the number of students In the regression analyses and is somewhat less than those reported in Table 1. 

r ' (0) - Ordinal Variable 
< (N) - Nominal Variable 

XD) " Dldiotooous Variable 




The multiple regression analysis can respond specifically to the 
question of "How much of the variance in gain scores for the low-groups 
can be accounted for by a combination of the variables studied?" 

Twelve variables were entered into stepwise multiple regression in 
order to determine their total contribution to the aiiount of variance 
in gaUn scores which was associated with the characteristics studied. 
The first two variables to be included were: 

(1) SOCIO-ECONOMIC STATUS . Because so much of the variance in 
achievement scores is often attiibut-ed to socio-economic status ^oleman 
1966; Thorndike, 1973) and because it is essentially not readily changed 
by programming, this variable was taken into account at the outset. We 
assigned 10 possible values of SES from responses to the questionnaire 
(see Appendix H) which represent a' range from those programs where all 
of the children wexe of low SES to those where all were of high SES. 
Tl^is coding allowed us to treat the SES variable .as an ordinal scale 
across all studies, although the majority of sites for low-groups report 
ed SES in cur three lowest coded -values. 

(2) ETimiCITY . Because this characteristic , is also not alterable^ 
it was decided to account for it immediately. It was intended that 
ETHNIC categories would reflect cultural groupings which might include 
some combination of race, ethnicity and religion. Therefore* race and 
ethnicity are somewhat combined in this variable.^ ^Hie categories of 
"American' Indian," "Black," "White," "Spanish-speaking or surname" 
(included both Chicano and Puerto Rican) , "Other" (Portuguese, Polish, 
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Irish, French^ etc.) were used. Combinations of these categories were 

also coded. "White" was the category used for white children for whom 

we had no evidence of an identifiable strong cultural influence* 

It is important to note that our information on these two variables 

was not based on^the actual SES or ethnicity of the individual child. 

(Such data were generally not available.) The data came from a des- 

/ -i \ 

crlptlon given of ,the group of students In the programs. 

The remaining variables selected for inclusion in the regression 
a<luatlon Were chosen because a) they showed a high correlation with 
gain scores for the ^ low-groups (Table 4), b) they could be susceptible 
to program direction o£ control, and c)-4:lie amount of mlSsing data-was 
insignificant. Previous research and conventional wisdom supported 
. our selections in roost instances. The variables incliide^d were: 

3. SIZE.OF INSTRUCTIONAL GROUP. Specific teacher-student ratios 

and cozbbinations of \these were 
necessary. 

*• ' < 

4. HOURS OF READING INSTRUCTION IN PROGRAM. Actual number of hours 

per week S:tudents were 
^ given reading instruction^ 

in the program. 

5. SOURCE OF INSTRUCTIWJ. Who or what gave students reading' 

instruction in the program? (classroom 
teachsrs, spe^'iialists^ tutors, machines, 
etc.) « 

6. LOCATION OF INSTRUCTION.' Where were students given instruction 

under the program? (classroom, lab y*^- 
or; resource room, reading center inf^ 
another building, etc.) ^/\| 

. 7. TEACHER TRAINING. If available, was training given during the 

program or prior to it, was it; general or 
specific to theo program? 

8. PARENT" Gl^^ypa INITIATED AS PART OF THE PROGRAM. If present; 

V V advisory council only, 

'V^- general support meetings, 

j^' support groups or home 

4U visits, combination 
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9. STUDY SKILLS, the extent to which, study skills were emphasized 

in program 

10. LANGUAGE ARTS, the extent to which the integration of language 

arts was emphasized in program 

11. ROLE OF PROJECT CONSULTANT: management, inservice, training, 

work with teachers, work with 
' students, other, combination 

12. CHILD WORKER, social worker, psychologist, or guidance for 

children provided by the program (beyond the 
^ ' school's usual practice): yes or no 

A description of the other program variables included in Table A 
is included below for reference only. No further analyses were com- 
puted foi; these variables. * 

TUTORS. Present or not, volunteer, paraprofessionals, 
specialists, machines, mix 

STUDENT SELECTION: ho^-^ were students chosen to participate 

in the program? achievement, SES, 
combination, randomly, or other 

DEVELOPMENTAL READING AS PART OF THE PROGRAM: yes or no 

REMEDIAL PROGRAM, extent to which program was remedial in 

nature 

ENRICHMENT PROGRAl-l. extent to which program included enrich- 
ment activities 

"OTHER" PROGRAJl. Extent to which program included treat- 
ments other than reading (e.g., perceptual- 
motor training) 

DECODING SKILLS: the extent to which decoding was emphasized 
in program 

COMPREHENSION, the extent to which comprehension was empha- 
sized in program 

WRITING SKILLS: the extent to which writing skills were empha- 
sized in program 

SPEED kREADING AS- PART OF THE PROGRAM, yes or no 
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TABLE 5 

^ MULTIPLE -REGRESSION OF VARIABLES ON GAIN SCORES 

Cumulative Proportion of Variation in Gain Scores Associated v/ith Variables Entered into Regression Equation (r2) 



/■ • 

\ 

Group 


Grade 


Variables ' 






SES 


Etbnicity 


Size of Instruc- 
tional Groups 


Hours of Read- 
ing Instruction 


Source of 
Instruction 


Location of 
Tnfitntpf Ion 


Teacher 

X 1. dxii xii ^ 


Parent 

vi LUUpo 


Language 




2 


.004 


.263 


. .375 


.378 


.378^ 


.384 








#16 


3 


.027 


.261 


.341 


.342 


.431 










//20 


3 


.070 


.116 


.245 


.320 


.321 










ni 


,4 


.010 


.121 


.233. 


.248 


.340 


.352 


.358 


.364 




//32 


5 


.061 


.100 


.227 


.249 


.266 


.283 


.283 




.288 


#37 


6 


.036 


.263 


.303 


. '.303I 


.351 











1 

Partial correlation of this variable was 0.0 at this point in regression 



As indicated in Table 5, the amount of variance in the gain scores 
which can be accounted for by th'=t variables studied^ varies somewhat for 
the different grade levels. Generally, however, between 30% and A0% of 
the variance in gain scores is associated with the variables studied i 
and no more than eight of the twelve variables contributed to the var- 
iaiice for any group. 

The contribution of program variables after SES and ETHNICITY had 
been accounted for was considerable. Their additional contribution to 
the variance was from a low of 9% for the sixth grade group to a high 
of 24% for the fourth grade group with the others in between. These 
percentages are quite substantial when one considers that the total 
variance in gain scores under investi3ation was very small, approximately 
1.5 to 3.5 raw score points per month. What we have found is that 
10% to 25% of the differences in gains scores between a pre- and post- 
test in reading for groups consisting of only low achieving students 
was accounted for by the specific characteristics of their reading 
programs. 

In Table 5 the addi t ion a T amount of variance accounted for by 
each variable is a function of the order in which the variables were 
entered. Had any one variable been entered first afcer SES and 
ETHNICITY, its contribution would probably have been greater. There- 
fore it is mere appropriate to assess :he contribution of individual 
variables, after'SES and ETHNICITY have been accounted for, by 
inspecting partial correlations. 
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Partial Correlations and Analyses of Variance 

TJie results of these analyses will be discussed together because 
while the first indicated the relative strength of the association of 
individual program characteristics with gain scores, the analyses of 
variance must be referrecl'^tf^in order to determine if there was a 
pattern of relationships between the program characteristics and the 
gain scores. A significant contribution to the variance evidenced 
by a high partial correlation can be elusive. Not infrequently the 
pattern of relationship was not clear because no one treatraent (or 
value) for a given variable had higher gain scores across grade levels. 
And the pattern of change across the grade levels was not clear either. 
This was particularly true for the transformed nominal variables 
where different contrasts occurred at various grade levels. There are 
many reasons why such inconsistencies occurred, but it is best to bear 
in mind that for every' group on each variable the findings ^re always 
relative to one another, they are hot absolute. They are influenced 
(1) by the number of categories or values on each variable actually 
present fpr that R^oup , (2) by the number of sites represented, 
(3) the number of children from each site, (4) perhaps by other 
inter-related variables and, of course, (5) by the effectiveness of 
the program at each site represented. 

ETHNICITY ^ 

Before we discuss the program characteristics we ought to consider 
the increase in variance in gain scores accounted for when ETHNICITY 
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was entered into the regression statement after SES (see Table 5) • 
Sltd.lar to the positive and negative correlations for the SES variable 
(see discussion on page 20) , no clear patterns emerged across grade 
levels. .An inspection of the anova table reveals that in grade 2 
— (Group-~9^) "White" children made th^ greatest gains ^Table 6). In 
grade 3 "Spanish and I^ite" were superior and some mix of ethnic 
groups for Group 20; "Black" students were superior at grade 4 and 
"White" again for grades 5 and 6. The contrasts within the ethnicity 
variable were not the same from group to group. Given the contrasts 
that did exist, the achievement of higher mean gains by different 
ethnic groups was nevertheless encouraging. One cannot conclude that 
one ethnic group consistently performed better than any other. We can 
then infer that students from various ethnic backgrounds can be ex- 
pected to ^achieve greater or lesser reading achievement gain scores 
depending on factors other than ethnicity . 
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TA6LE 6 



ANALYSIS OF VARIAWOE 
Mean gain scores (standur<i deviations), and N for various 
values. of ETHNICITY and probability of mean differences 



Indian 



Black 



White 



Black & 
. White 



Spanish 
& White 



Other 



mean (SD) « mean (SU) mean (SO) mean ^D) mean (SI)) mean (Si>) F P 



■ w 



• 9 
(M 



2 

189) 



2.03 (.6) 
K = 4 



2.09 (1.3) 
N = 17 



3.72 (1.6) 
N = 86 



3.22 (1.7) 
N = 78 



3.25 (1.7) 4.27 .01 
N = 4 



16 
(N 



3 

136) 



1.81 (1.0) 
N = 19 



2.64 (1.5) 1.47 (.8) 14.87 .001 
N = 37 N = 80 



20 3 2.43 (.9) ,2.71.(1.7) 4.10 (1.8) 3.09 (1.7) 2.86 (1.1) 4.14 (1.0) 

(N = 252) K = 12 N =38 N = 70 N = 112 N = 16 N = 4 5.85 .001 

27 4 1.85 (1.3) 5.16 (l.£) ^ 3.57 (2.4) 2.51 (1.7) 3.28 (2.0) 2.58 (1.9) .10.29 .001 

(N = 430) N .= 24 N = 10 N = 126 = 183 N = 50 N « 37 

32 5 .90 (.9) 1.24 (.9) 1.97 (1.1) 1.28 (1.1) 1.23 (1.3) 1.46 (.9) 6.16 .001 

(N = 306) N = 21 ■ N = 37 7i' = a3 N = 108 N = 41 N = 16 



ERIC 



37 6 
(N = 250) 



-47 



1.,.05 (.82) 1.37 (1.5) 1.89 (1.2) 1.66 (1.1) 1.06 (1.02) 1.18 (.82) 2.42 .05 
N = 7 N = 43 iV = 45 = 1'./ « = 24 N = 14 
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Program Characteristics 

The relative strength of individual program characteristics after 
the background characteristics of SES and ETHNICITY have been partlaled 
out are found in Table 7. The partial correlations tended to be great- 
er at the second and third grade level than for grades 4, 5, and 6. This 
was particularly noticeable for the SIZE OF INSTRUCTIONAL GROUPS, TEACHER 
TRAINING, PARENT GROUPS, and for CONSULTANtS.. Further investig^^tion 
of these variables at the lower grade levels will probably have tnpre 
payoff than at the upper grade levels. .SOURCE OF INSTRUCTION achieved 
the highest correlation^ across most groups but different variables 
were strongest at the various grade levels. The three variables with 
the highest correlations were SIZE OF INSTRUCTIONAL GROUP, SOURCE OF 

INSTRUCTION and PARENT GROUPS. ^^^^---.^ ^ 

Our correlations and associated variance estimate^ indicate^ that 
the school program characteristics did add considerably, though differ- 
ently, at different grade levels. The data emphasize the importance of 
different aspects of special programs designed to improve reading 
instruction. Program characteristics make a difference to low achieving 
students. Let us now explore the nature of these differences and make 
some related hypotheses. 
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TABLE 7 
PARTI At CORRF.UTIONS 



PArtt-il CorreJutionji (R) nnd VarUncr (R^) for Selected- Progrnm Vnrinblefl with Ciln Scores after 
Sns and RTIIHICITY were entered Into Multiple Rrp.reqjilon on Cain Scores for Selected Variables 



\ 



Croup 


< 












Variables 










T 








\ 

\ 










Size of 
Instructional 
Croups 


Hours of 
R*»adlnj5 
tnstrtictlon 


Source of 
Inst t urt 1 on 


Loratlon of 
Ir stru<:tlon 


Teacher 
Train Ing 


Parent 
Croups 


Study 
Sktlis^ 


Langu'ige 
Arts 


1...... 


Child 
Social /Other 
Worker 






R 


r2 


R 


r2 


R 


?? 


R* 


r2 


R 


r2 


R 


r2 


R 


r2 


R, 








R 


r2 


«9 


2 


.362^ 


.131* 


-.159 


.025 


.370'' 


• 137'- 


.2 37* 


.056* 


.359* 


.129* 


. 353* 


.123* 


.097* 


.009* 


.148 


.022 


.303" 


\ 

.092' 

\ 

.054^ 


0 


0 


«]6 


3 




.093* 


.09A 


.009 


.307'- 


.094* 


.391 


.151 


.466* 


.217* 


U315* 


.099* 


.139* 


.019* 


.278* 


•077* 


.232* 


.097 


.009 


^20 


3 




.116' 


.159 


.025 


.197'' 


.039* 




* 


.•i02* 


.^85* 


.291* 


.085^' 


.411* 


.169* 


0 


0 


.29/* 


•088* 


^^318 
,2^0 


.lOT 


#27 


^ U 


.I6fl^ 


.028* 


.080 


.006 


.222* 


.049* 


.254* 


.065* 


.127^ 




• 171* 


.029* 


.208* 


.043* 


* 


* 


.159* 


.025* 


.084 


#32 


. 5 


.239* 




.148 


.022 


.791* 


.085* 


.211* 


.045* 


.193*^ 


.037* 


.190* 


.036* 


.172* 


.030* 


.308* 


.095* 


.141= 


.020* 


.218^ 


^.048 


#37 


6 


.195^ 


.038* 


.?2fl 


.052 


.291* 


.085* 


.175* 


.031* 


.198* 


.039* 


.227* 


.032* 


.101* 


.010* 


.144 


.021 


.249* 


.062* 


.123 


\ 

.0^5 

\ 



*tiot computed, not cnour.h data available 
*Wo variance • 

*'nic r.r<*J^t^t_j>-jrUal correlation from sot of contrasts for this transforfned variable is given as an lapproximstion' of 
the mlnlmjl total variance for that variable. v 
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What hypotheses are suggested concerning the -effectiveness of certain 
program characteristics? 

SIZE OF INSTRUCTIONAL GIX^UPS . This variable added considerably 
to the variance Accounted for, particularly in the primary grades 
(Table 7). Across all grade levels the highest gain scores were 
achieved in small groups (2 to 5) and/or individual instruction^, 
except for grade 5 (Table 8). The fifth graders who achieved the 
highest mean gains were in instructional groups of ten or more. An 
inspection of the original data revealed that the 16 students who 
contributed to that high mean $ain were in a program where the. vhoiLe — 
class worked in their classroom with a teacher trained to manage the 
diagnosis of reading problems, to pl^m individualized instruction and 
to assess progress continuously* More generally, sm^**ll groups are 
more likely to allow for such accomodation O'f^ instructions to fit 
the individual* When we examined the data from those sites effecting 
the greater mean gains, all but one^of the fourteen reported a program 
of instruction tailored to the individual needs of the child, mpst 
often deteinained by diagnostic or criterion referenced testing. The 
instructional program was then followed through with an individual, a 
small group or, as for grade 5, a larger grcJup but h diagnostic, 
Individualized teaching. 



Two recent studies found essentially the same results (McDonald ,- 
1976 and Stalllngs, 1975). 
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TABLE 8 

ANALYSIS OF VARIANCE 
Mean gain scores (standard deviations), and N for various 
values of SIZE OF INSTRUCTIONAL GaOUP and probability of mean differences 



Group Grade 



1:1 



mean 



(SD) 



liZ to 1:5 1:." to 1:10 



mean 



(SD) 



mean (SD) 



1:10+ 



1:1 and 
1:2 to 1:5 



1:1 and 
other 



mean (SD) mean (SJ)) mean (SD^ p 



9 2 3.58 (1.5) A. 80 (1.6) 1.A7 (1.3) 

(N = 189) N « 63 . N = 32 N -'15 



3.08 (l.A) 2.69 (1.6) 16. AA .001 
N = 3A N » A5 



16 
(N 



20 

(n" 



3 

136) 



, 3 

252) 



27 A 
(N = A30) 



2.09 (li5) 
N = A9 



3.A9 (1.5) 

N = 48 



A.A7 (1.7) 
N « 55 



-.82 (1.0) 
N = 53 

^ 



^ 3.2A (1.8) 3.36 (2.1) 1.83 (l.A) 
N = 65 ^ N = 137 N = 37^ 



1.A6 (.3) 
N = 6 



2.52 (1.3) 
N = 6A 



2.90 (1.9) 2.93 (1.8) 



N - 5 



N » 96 



1.A9 (1.0) 1.82 
N = 28 



2.97 (1.7) 16. 9A 
N = 85 



2.55 (iv9) 5.02 
N = 90 \ 



.001 
\ 

.001' 



32 5 1.7A (.93) • 1.75 (1.1) .72 (.62) 

(N « 306) N = 27 N = 97 N » 31 



2.3A (l.A) 1.55 (.95) 1.07 (1.1) 9X96 .001 
N = 16 N = Al N = 9Ai 



ERIC 



37 6 
(N = 250) 



53 



1.55 (1.1) 2.05 (1.3) / .72 (.7) 



N - 18 



N = 62 

/ 



N = 18 



1.A6 (1.7) . 1.70 (1.2) 1.07 (.99) 6.77 .001 
N - 6 N = 86 N » 60 
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The SIZE OF INSTRUCTIONAL GROUP was apparently very important 
to the reading achievement of pupils^ in the studies investigated. Our 
data suggested the hypothesis that individual and small group instruc- 
tion vlll yield higher .gain scores on reading achievement tests for low 
acltievlng students , 

HOURS OF READING INSTRPCTION refers only to the time spent on 
reading in the varipus special reading programs imder study '(not the , 
variable "hours of regular reading instruction" discussed on page 22)^ . 
In some cases these hours were in addition to the regula^ classroom 
reading and in others they were a substitute for it. The correlations 
of this variable with gain scores were generally negative XTable 4), 
and one can only speculate as to "why?". Our questionnaire may not 
have been sensitive to differences in the hours per week spent in 
reading instruction for the programs under study. Another question to 
raise con^cems the actual amount of reading done by students in pro- 
grams where more hours were reported, especially when larger instruc- 
tional groups were used. Such large groups would report "exposure" 
^time, but the time spent actually attending to the task may have been 
considerably different. On the other hand, the hours of reading 
instruction for the child who receive.d individual attention or who 
was in a small group would be reported as less, though it may have 
been less exposure time and more time on fcask.^ 



■"-While the correlations with "hours of regular reading instruction" 
were generally high and positive, this variable was not a program variable 
and therefore not analyzed further. 

2a more appropriate measure, used by Stallings (1975) and others, 
reports on observed reading activity for individual children. She con- 
cluded "...the average time* a child spends engaged in a reading activity 
(is) related to higher reading scores in both first and third grade (p. 100) 
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When SES and ETHNICITY are' controlled for, the partial correla- 
tions of HOURS OF READING INSTRUCTION with gain scores were very small 
except for grade 6 (Table 7), smaller in fact than most of the other 
Variables under consideration. Unfortunately an analysis of variance 
was not computed for this variable. Such an analysis would help in 
specifying the point at which more instructional hours produced neg- 
ative correlations and also would make it possible to trace the data 
back to specific sites and look at the interaction with INSTRUCTIONAL 
GROUP SIZE. The predictive power of hours of instruction per weak in 
sptcial reading programs to reading achievement gains for low achieving 
students is not very great when SES and ETHNICITY are accounted for 
first . 

The SOURCE OF INSTRUCTION indicates who instructed the students • 
in the program; classroom teacher, specialist, tutor, machine, (e.g.,- 
the EDL controlled reader, audio cassettes, etc.), a certified teacher 
who had been given training in order to function as a specialist 
(usually in reading resource rooms), the classroom teacher in cooper- 
ation with a reading specialist, the teacher and a tutor, the teacher 
and a machine, a tutor in cooperation with a specialist, a specialist 
.and machines, or the teacher and tutors and machines combined. 

This variable was a strong predictor after SES and ETHNICITY were 
partialed out (Table 7). At the fifth and sixth grade levels it had 
a higher partial correlation than any of the other variables. 

For all but two of the groups, the programs undertaken by 
reading specialists were consistently better (Table 9). In one excep- 
tion (grade 2), specialist and tutor groups achieved the highest gains. 
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ANALYSIS or VARIANCE 
Mp;m r.n*«» Rcoro«i (stnixlnrd d*>viat Inns) . and N for varlotis 
values nf ioUHrt OF IHSIRUCTION nn«l prol>at>l 1 Ity of mcnn dlf f ere nco»; 



Ttt?ch«r Spec Ul 1st later s 



UitliiM'r 1.-nchoi .iiul Trnrhor and SprrlalUt SpoclallKt Toachor, 

SpfiMnl Isl Siu-i laUsl JJ.K-hlnos .m,! Tutor and Machine*? Tutors h 

Hnchincs; 



Mil 



fro. in Si) 



MO. in Sl> 



mean SU 



mean SO 



neun SU 



recan SU 



(fj - 139) 



16 ) 



2/J 3 
(fJ ' 252) 



(H » A30) 



1 S 
(M - 306) 



37 f> 
(a - 250) 



IA7.(1.3) 3.35 (1.6) 
W « 15 N - 79 



l./O (.a) 2.07 (.9) 

- 31 K )0 



3.M (i.y) 
w - ir^ 



1. 1)7 (l.-)) 3.6^ (7.2) 
- 11 N - 10«) 



1.70 (1.7.) (i.n 



1.66 (1.7) 7.25 (1.1) 



3.li (l.'») 

ti - 13 

^ 1.5/. (1.0) 

(1.2) 

:.l/. (1.3) (2.U) 7.2/. (!.•>) 

:c . ^u - 3^ - 3v 

1.01 (1.0) \.Vf (1.2) .95 (.») 

U - 16 ' N » 22 iS' • 

1.60 (1.7) .8rt (.72) 
N ' 14- . " 21 



3.65 (1.7) 
N - H2 



3.67 (1.2) 
N - 20 



J. 26 (1.6) 
" 10t» 



3.oy C2.0) 
N - 162 



1.06 (.B) 1.27 (1.1) 
- 3 N • 106 



.76 (.67) 1.62 (1.2) 
N - 7 hi - 136 



7.63 .001 



23.8:J .001 



7.78 .001 



2.11 (.9) i.31 (1.6) 5.81 .001 
S - N - 16 



1.66 (1.05) 1.65 (.6) 6.26 .001 
N - 13 N - 7 



1.60 (.9) 
N - 16 



5.69 .001 
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This combination was very effective at other grade levels as well. 

In another exception (in the third grade), the "teacher plus machines" 
was most effective. The "machines" for these students were tape cassettes 

anc' film projectors used to introduce new vocabulary and to supplement 

instruction in reading. In addition, children taped their own reading and 

listened to it leading to increased expression in oral reading. These. 

results were from 20 children in an experimental program run by the 

teacher. 1 



At the third and fourth grade levels, programs administered by the 
classroom teachers were least effective raising the possibility that 
pre- and in-service training of teachers in reading instruction may be 
useful.^ The gap between the expertise of the reading specialists who 
achieved better results and the classroom teachers bears further inves- 
tigation. 

The hypothesis suggested on the basis of the strong correlation 
of SOURCE OF INSTRUCTION with gains and the difference in mean gains 
is: programs for low ac! ^eving^ children offered by reading specialists 
will generally yield greater ^aln scores on 'reading achievement tests 
than other programs . 



A major recommendation of the National Academy of Education in 
Toward_a Lite rate Society (1975) was that a larger part of the reading 
problem can be solved by attention to teacher training. (Carroll and Chall,1975) 
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In gr^ies"5-and 6, the combination of a "specialist and teacher" was 
associated w£th low gain scores. Since only two sites had this com- 
bination, it was possible to examine their program descriptions to de- 
termine how the specialists functioned. In one case the specialists' 
roles were defined as primarily working with individuals on language 
development and perceptual skills, not reading per se. At the other 
site one specialist was available for all«18 learning centers. ^ This 
same site had much better than average gain scores at 'grades 2 and 3, 
but not for. grades 5 and 6. It is perhaps safe to assume that it was 
Impossible for tl\e specialist to influence Instruction at al] levels 
with such a' heavy responsibility. 

LOCATION OF INSTRUCTION . Three different types of "locations" 
were defined: classroom (when the reading program under study consisted 
of work done right in the classroom), laboratory or resource rooms 
(this term encompasses reading rooms, etc by whatever name, as long 
as they were located within the school building) and reading centers 
located outside the school building. 

The partial correlations indicated this to be a relatively strong 
variable for four of the six groups. No single type of location was 
consistently related to higher gains (Table 10); however, further 
investigation witK our own data could determine the interaction between 
this variable and SOURCE OF INSTRUCTION which could help to indicate the 
circumstances under which specific locations are best. 

We must conclude from our data as analyzed that successful programs 
can be mounted in all types of settings ; classrooms, reading resource 
rooms, and reading centers located in other buildings. 
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ANALYSIS OF VARIAMCE 
Mean gain scores (standard deviations), and N for various 
values of LOCATION OF IjisTRUCTIOAl and probability of mean differences 



Classroom 



Lab or Resource Koom 



Reading Center 



Groujg. G rade 



mean 



(SD) 



mean 



(su) 



mean 



F P 



9 2 
(N = 189) 



1.47 (1.3) 
N = 15 



3.55 (1.7) 
ti = 162 



2.55 (1.1) 
W = 12 



12.74 .001 



i6 3 
(N = 136) 



1.88 (1.3) 
K ^ 71 



1.78 (1.0) 
H = 65 



.22 



20 3 
(N = 232) 



3.35 (1.7) 

N = 243 



1.54 (.7) 
^^ = 9 



9.99 .01 



27 4 
(N = 430) 



3.55 (2.U) 
ti = 35 



3.11 (1.9) 

N = 334 



1.51 (1.1) 
Ji = 52 



18.74 .001 



32 5 
(« = 306) 



2.47 (1.5) 
N = 25 



1.45 (1.0) 
N = 237 



.806 (.742) 
= 43 



19.88 .001 



37 6 
(N .= 250) 



1.77 (1.5) 
K = 12 



1.51 (1.2) 

ti = 230 



2.39 (1.6) 
£j = 8 



2.29 



^1 



TEACHER TRAINING ♦ Tffe-partlal correlations (Table 7) indicated that 
this variable was associated with gain scores but the pattern of associa- 
tion was unclear (Table 11). Perhaps our categories of "specific" and 
"general" training as well as "pre-program" or "during program" training 
were too ambitious and diluted the simple effects of training versus no 
training* 

In going back to the fourteen individual sites where gain scores 
were obvioualy^ higher than others within any given group, certain common-- 
alities /on TEACHER TRAINING became apparent and were consistent with 
the correlations. All these sites had provided training for the teachers. 
School (systems) concerned about teacher growth usually provide training 
and, of course, it may well be that such systems are in general more 
supportive of teachers. * 

rue hypothesis suggested (data from one, group notwithstanding) is 
that some teacher training as opposed to none will enhance lower achieving 
students' gain jcores in reading achievement * 
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TABLE 11 



ANALYSIS OF VARIANCE 
Hean gain scores (standard deviations), and N £or various 
values of TEACHER TRAINING and probability of mean differences 



} . Specific General Specific Specific 

Training during Training during before before and 

Program Program Program during 

Group Grade I 

nean(SD) mean(SD) mean(SD) mean (SD) mean^So) F P 



^ (N - 189) 



1.A7 (1.3) 
N - 15 



3.29 (1.6) 
N - 79 



3.58 (1.5) 3.74 (2.1) 7.65 .001 

N - 63 N - 32 



16 3 
(N - 136) 



3.47 (1.2) 
N - 20 



1.59 (.9) 
N - 94 



1.46 (.3) 
N » 6 



1.39 (1.1) 22.07 .001 
h - 16 



20 3 
(N - 252) 



3.57 (1.9) 2.86 (1.1) 3.49 (1.5) 2.86 (1.6) 3.35 .05 

N - 107 N - 16 N " 48 N « 81 



27 4 
(N - 430) 



2.01 (1.4) 
N - 24 



2.60 (1.9) 
N - 165 



4.51 (1.6) 3.52 (1.7) 3.01 (2.0) 8.12 .001 

N - 22 N - 57 N - 162 



32 
(N 



5 

306) 



1.92 (1.2) 
N - 66 



1.14 (.82) 
N - 103 



2.73 (1.9) 1.74 (.93) 1.25 (1.1) 9.89 .001 

N - 8 N « 27 N - 102 



37 
(N 
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1.84 (1.2) 
N « 34 



1.45 (1.0) 
N - 117 



2.08 (1.2) 
N •> 6 



1.55 (1.1) 
N - 18 



1.53 (1.5) .99 
N - 75 
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PARENT GROUPS > ^There were some high partial correlations on the 
PARENT GROUP variable /Table 7) . The responses to our questionnaire 
were coded so that five descriptions of parent^ groups wei>e possible on 
this variable: none (where there was no parent involvement), general 
meetings (where there was no advisory council but meetings were held 
with the parents), advisory council and general meetings (both), and 
oome other combination (involvement that might or might not include 
advisory councils, general meetings, and some other component) • The 
anova data (Table 12) indicated that in no case was "none" associated 
with highest gain scores. Foi\ only one group were there higher gain 
scores where, advisory councils \jere not included and for four groups 
the advisory-council-only categorv had students with significantly 
superior gain scores. Such groups are mandatory for Title I projects 
and the fact that they are associated with greater gain scores for 
these low groups reinforces that aspect of Title I. 

We hypothesize that: parent involvement is a positive aspect 
of reading programs for low achieving students and parent advisory 
councils are an effective means for such involvement. 
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ANALYSIS OF VARIANCE 
Mean ^aln scores (standard deviations) , and N for various 
values of PARENT GROUPS and probability of mean differences 



Group Grade 



none 



mean 



(sd) 



Advisory 
Council 



mean 



(SD) 



General 
Meetings 



Advisory Council 

and General Other 
Meetings Combinations 



mean 



(sd) 



mean (sd) 



mean(SD) 



9 i 

(N - 189) 



3.06 (1.5) 
N - 103 



4.89 (1.2) 
N - 18 



2.91 (1.6) 
N - 36 



3.74 (2.1) 
N - 32 



7.98 .001 



16 3 
(N - 136) 



1.14 (.6) 
N - 29 



3.47 (1.2) 2.07 (.9) 1.49 (1.0) 29.29 .001 

N - 20 N - 30 N - 57 



20 3 
(N - 252) 



3.00 (1.4) 
N - 79 



5.43 (1.5) 
N - 22 



3.42 (1.7) 2.86 (1.6) 16.78 .001 

N - 70 N - 81 



27 4 
(N - 430) 



2.73 (1.5) 
N - 152 



5.17 (2.7) 
N - 23 



2.61 (1.5) 3.49 (1.8) 2.69 (2.0) 11.09 .001 

N - 15 N - 56 N - 184 



32 5 
(N - 306) 



1.52 (.88) 
N - 69 



2.13 (1.09) 
N - 34 



1.16 (.77) 2.24 (1.4) 1.12 (1.0) 12.44 .001 

N - 23 N - 31 N - 149 
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1.77 (1.1) 
N - 62 



2.30 (1.0) 
N - 21 



.76 (.7) 
N - 7 



1.-77 (1.5) 1.37 (1.2) 4.46 . .01 

N » 12 ' - 148 
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STUDY SKILLS AND LANGUAGE ARTS . We questioned the emphasis placed 
on DECODING <phonics and word analysis skills) STUDY SKILLS (strategies 
which enable the reader to organize and thus aid in recall and analysis 
of material read, such as outlining, summarizing, setting goals, etc.) 
COMPREHENSION, SPEED (increasing the pace of reading) WRITING (not pen- 
manship) , and LANGUAGE ARTS (the integration of reading, language and 
writing instruction). Of these, emphasis on STUDY SKILLS and LANGUAGE 
ARTS appeared to *be most related to reading gains and so they were 
included in the regression and partial correlations computed. 

The correlations (Table 4^and the partial correlations (Table 7) 
indicated that both are important variables."'' Our da^-a indicated that 
teaching study skills ^n either a minor way or emphasized) is associated 
with greater gains than when they are not taught, (Table 13), and although the 
evidence is not strong, we would hypothesize that there is a be neficial 
effect when attention is given to study skills beginning in grade 2. 



\ 



^Unfortunately the analysis of variance on LANGUAGE ARTS w^ not 
computed and we are unable to make any hypotheses for it. 
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ANALYSIS OF VARIANT:!: 
Mean s^^in scores (standard deviations) , and .N £or various 
values o£ STUDY SKILLS and probability of mean differences 



none 



Minor 



Emphasized 



raean 



(su) 



mean 



(su) / 



mean 



(SD) 



F P 



9 2 
(M •= 189) 



1.61 (1.2) 
N «= 24 



3.57 (1.8) 
K » 89 



3.56 (1.5) 
N = 76 



15.80 .001 



16 3 
(N - 136) 



1.28 (.67) 
N - 41 



1.79 (.98) 
N - 59 ■ 



2.54 (1.5) 
N - 36 



12.96 .001 



20 3 
(N - 252) 



1.90 (.92) 
N - 31 



3.65 (1.8) 
N - 144 



3.15 (1.5) 
N - 77 



15.16 .001 



27 A 
(N - 430) 



32 5 
(N - 306) 



1.47 (1.2) 
K - 72 



.749 (.85) 
N - 46 



3.22 (2.0) 

N « '222 



1.41 (1.0) 
N » 137 



3.26 (1.8) 
N « 136 



1.73 (1.2) 
N - 123 



28.23 .001 



14.08 .001 



37 6 
(N - 250) 



1.81 (1.3) 
N - 91 



1.40 (1.1) 
N - 159 



6.75 .01 



CONSULTANTS > . We has questioned whether (1) there v/as a consultant 
and (2) did that person function as an administrator, (3) do in-service 
training, (4) work with teachers in the classrooms, (5) work with stu- 
dents in the classrooms, (6) have other functions, or (7) some combination 
of these. 

For the low groups studied, **other function** yielded the highest 
gain scores in all but one case (Table 14)., Again, the original pro- 
gram descriptions for these groups with high gains, established that 
"other" included evaluation and/or program design. We would therefore 
hypothesize that the use of consultants to aid in program design and/or 
for program evaluation will enhance achievement gains "^or the low achiev- 
ing children . 

SOCIAL/GUIDANCE WORKERS FOR STUDENTS. This is a dichotomous 
variable with either a "yes" or "no" response and it combined the 
responses to several questions on pupil personnel. A "yes" response 
indicated that such personnel were available to children as part of the 
program under study and did not include cases where the services were 
no more than they would be in the usual school situation. 

The higher correlations (Table 4) tended to be for grades 3 and 

4 and they were maintained when SES and ETHNICITY vjcre partialed out 



others ^tudied but it may warrant furt^her investigation, particularly 
at the middle grades where the reading task is changing. On the basis 
of our data we hypothesize that providing special personnel, social or 




In general, it was not as strong a variable as many of the 



guidance workers, for low achieving students will enhance their reading 



achievement gains. 
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TABLE 14 

5 

ANALYSIS OF VARIANCE 
Mean gain scores (standard deviations) , and N for various 
values of CONSULTANTS and probability of mean differences 



Group Grade 



noHe 



In-service 
Training 



Evaluation and /or 
Program Design 



Combination 



mean 



(SD) 



mean 



(SD) 



mean Csd) 



mean 



(SD) 



tn 



9 2 
(N - 189) 



3.17 (1.6) 
N - 82 



2.92 (1.5) 
N - 70 



' .89 (1.2) 
N - 18 



3.90 (2.3) 8.03 .001 
H - 19 



16 3 
<N - 136) 



3.0 (1.4) 
N - 26 



1.82 (1.0) 
N - 53 



1.39 (1.1) 
N - 16 



1.28 (.7) 16.38 .001 
N - Ax 



20 3 
(.N « 252) 



3.38 (1.4) 
N - 68 



2.92 (1.6) 
N - 110 



5.43 (1.5) 
N - 22 



3.00 (1.7) 16.21- .001 
N - 52 



21 ' 4 
(N - 430) 



3.24 (1.8) 
N - 139 



2.35 (1.6) 
N - 120 



5.17 (2.7) 
N - 23 



2.79 (1.9) 17.15 .001 
N - 148 



32 5 
(N - 306) 



1.95 (1.2) 
N - 71. 



1.12 (.92) 
N - 83 



2.13 (1.1) 
N - 34 



1.15 (.98) 16.60 .001 
N - 118 
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(N - 250) 
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1.45 'a.i) 

N - 55 



1.79 (1.4) 
N - 48 



2.30 (.97) 
N - 21 



1.37 (1.1) 
N - 126 



4.61 .01 
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Sunnnary of the Study of Relationships of Reading Achievement Gain Scores 
with Program Characteristics for Low Achieving Students , 

This section summarizes our tentative "hypi cheses about the effect 
of background and program variables on the gain scores of students who 
scored one standard Hpviation below the mean on reading achievement 
pre-tests — the low -groups. 

Partly because of the nature of our groups, SSS was not a power- 
ful predictor of gain scores for the low groups. Likewise the contrasts 
between ethnic groups present within our groups varied considerably 
and greater gain scores could not be predicted for any one ethnic group. 
Our data suggested the , hypothesis that students from various SES and 
ethnic backgrounds can be expected to achieve greater or lesser achieve- 
ment gain 3cbre3 depending on factors othej than SES and ethnicity. 

There were program characteristics which accounted for an addition- 
al proportion of the variance in reading achievement scores beyond that 
associated with SES and ETHNICITY. While our data did Qot generate one 

i. 

encompassing explanation for the relationship between program variables 
and achievement gains for all groups, the data did suggest some hypothe- 
ses concerning certain powerful predictors that may be found to be 
generalize able to many school situations. Tiie relationship of program 
variables to gain scores for the low-groups wer6 not dramatically 
different between grade levels/ The students in the low-groups in 

Multiple regression and analysis of variance techniques on the 
data from the mid- and high-groups might reveal more differences in the 
associated variables and these data are available from our study. 
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the fifth and sixth grades are actually still responding to reading in 
much the sama way as third and early fourth graders (see Volume II) 
and therefore the differences by grade level are not great. Most of 
our hypotheses concerning effective program components are tenable for 
grades 2 through 6. Actual hypothesis testing in schools would determine 
if there are causal effects in any of our correlational results. 

The following hypotheses are restated here to emphasize that these 
program characteristics, of all those we measured, are most consistently 
associated with gain scores of the lowest achieving children. 

1. Individual and small group instruction will yield higher 
gain scores on reading achievement tests for low achieving 
students. 

2. Programs for low achieving children offered by reading 
. ^ specialists will yield greater gain scores on reading 

achievement tests than other programs. 

3. Relevant teacher training will enhance lower achieving 
students* gain scores in reading achievement. 

A. Parent involvement is a positive aspect of reading programs 
for low achieving students and Parent Advisory Councils are 
an effective means for involvement. 

In addition to these hypotheses concerning the four program var- 
iables, certain other program characteristics are also powerful pre- 
dictors at certain grade levels. The most effective location for 
instruction was a "reading laboratory or resource room" for the earlier 
grades while the fifth grade students in **classrooms** had the highest 
gains. Two program components, language arts and study skills also 
accounted for significant amounts of variance without a clear patter 
of the relationship. Consultants for program design' and/or evaluation 
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and feedback appear to be asscjciated with higher gain scores for the low 
groups . 

The above variables need to be researched further to determine if- 
they contributed to the higher scores, what other circumstances were 
highly inter-related, and in what contexts they are most advantageous. 

Our review of the 14 programs which yielded the highest gain sctores 

for the low achievers led us to believe that effects might be pro- 
duced by management of the instructional process so that pupils have 
individually prescribed instruction based either on diagnosis"'- or 
continuous assessment (e.g., criterion referenced tests). Direct 
observations at the 14 sites would be fruitful and would further the 
process of "pinning down just .'hat joint action of situational variables 
produces a particular effect (Cronbach, 1974, p.l9)." - Classroom 
observations would offer more options to the researcher than our post 
h.c investigation where variables were necessarily limited. Success- 
ful programs were unique to their locale, unique to particular inter- 
actions between the personnel as well as the program features associated 
witli each project and the resources available. 

We are convinced that there should be no expectation that what is 
a model program in one community should be the best model in other 
communities. Our data somewhat shatters the mystique of model programs 
which include variables that will be effective in all cases. Never- 
theless, the several powerful predictors which kept reappearing do 
have relevance to policy decisions which we discuss in Section V. 



■'■Rider (19 72) found this to be characteristic of the nine Title I 
programs he identified as most e^^tive. 
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V. CONCLUSIONS, IMPLICATIONS, AND FURTHER STUDY 

Reports of recently Implemented reading programs were located and 
data solicited from project directors and/or school personnel which 
included school and program descriptors as well as individual sr.udent 

> 

achievement data from 36 communities. The data were analyzed to examine 
the relationship between achievement gain scores and program character- 
istics and also to identifv characteristics cf the schools serving the 
poorer readers. Volume II constitutes analyses of reading achievement ^ 
tests and speculations about., the differences in achievement for students 
at different grade levels, 1-6, 

Characteristics 'of Schools Serving a Large Number of Poorer Naders 
In our data, students making the smallest gain scores came from 

larger schools in lower socio-economic urban areas with fewer yhite 

'J 

students. Some differences with regard to their education include the 
fact that in these schools there was less teacher training, less teacher 
curriculum development, fewer consultants, fewer dollars per pupil spent 
and more social workers for students, as might be expected by their 
greater problems. 

Other differences seem to vary with grade level. Those students 
making smaller gain scores in grades 2, 3 and A generally went to schools 
where there were more tutors, where there were more reading specialists, 
fewer remedial programs, more enrichment activities, and more psycholo- 
gists and soQial workers for their parents. To date national attention 
has targeted more dollars to these lower grades and it v;as interesting 
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to find that in grades 5 and 6 there were fewer reading specialists, 

enrichment activities and social workers/psychologists for the par- 

ents, tut more remedial programs. Our findings emphasize the danger 
in makings "causality" statements about co-occuring events. In many 
cases the diff.erenqes reflected the implementation of special help 
for low achieving-tfitudents and its presence could hardly be said to 
"cause" low achievement. - . ^ e 

* • 'o 

" *** . 

It was not difficult to locate problem^areas. We now naed fur- 

ther research to determine if Some or any of the^ special services offered 

■J 

mostly to the primary grades should be incorporated at th^. upper grade 
levels. * ^ 

Program Characteristics Related to Gain Scores for Low Achieving Gfoups 

One of the most encouraging outcomes from our research is the 
evidence that program characteristics d£ contribute to differences found 
on the reading achievement test gain scores for the low achieving 
students even after SES and ethnicity have been° accounted for.^ 

The following particular program characteristics appeared fre- 
quently enough in conjunction with higher gain scores to warrant attention 
and further study: individual or small group^inst ruction, reading 
specialists, teacher training, and Parent Advisory Councils. 



^ "^Stallings (1975) has found this to be true of Follow-Through 
;ups and Bloom (1976) found evidence for it in his most recent 
t»^udy. McDonald (1976) also substantiates it at the second and 
fifth grade levels. 
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The exact nature of the contribution of program components to 
gain scores varies across grade levels and even within grade levels for 
dlfrerent programs. A strong Implication from our data for funding 
agencies l3 that they should not trv to man date all the specific aspects 
of programs . Rather than specifying what components should be Included, 
communities might be encouraged to work out their specific problems. 
However, they should also strongly be advised of the mounting body of 
evidence which supports small group and Individualized Instruction, 
reading specialists, teacher training and parent Involvement. Other 
of our variables (see summary in Section IV) and some variables not 
Included in our study also need to be researched and our suggestion 
would be to concentrate research on direct observation of program com- 
ponents as our evidence suggests that these do make a difference beyond 
background variables. 
, Differences in Achievement for the Low Group Grade Levels 1-6. 
\ Program efforts at all grade levels can and do produce achieve- 
ment gains. Nevertheless, there is a cumulative effect for every year 
o^ not gaining a full year in achievement and the fifth and sixth 
graders are further "behind" than the students in the primary grades. 
Vo,lume II addresses this issue and the cross sectional data we collected 
indicated that across the various programs the yearly growth, or pre- 
to post-test gain scoies, on standardized reading achievement tests 
was only slightly better at the lower (grades 2-4) levels. Itowever, ■ 
the drop in test scores between spring testing at the end of one academic 
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year and the beginning of the school year the following fall was start- 
ling. While our data were not from the same group across the grade 

levels (it was not longitudinal), the data seemed strong enough to . I' 

• / 

indicate that the "loss" o>^er the summer was a major contributor to / 

/' 

steadily decreasing scores in terms of grade equivalents. For a lo|^ 
group to make a gain of »8 and even 1.0 grades in an academic yea^ is 
a major acconqplishment . However, when that group loses anywhere from 
.5 to 1.0 grade levels over the summer, the scores relative to actual 
grade level decrease annually. Such losses over the summer are most 
evident for the low group and we suspect that longitudinal studies will 
probably substantiate losses over the summer as a major problem^ one 
which must be faced. Research on summer programs which encourage 
reading as well as teach reading might help to reduce those losses 
and to provide low-achieving students with more exposure to a 
"literate" vocabulary so necessary to advanced reading skills. 
Further Research \^ 

Nuflierous suggestions for further research are made throughout the 
report and those which seem most pertinent to gaining new insights into 
the teaching and learning ofV'reading'* which can then be translated 
into practice are mentioned briefly below along with further study whicji 
could be undertaken on the data we now have from the. 36 communities. 

' V7e n-.ed research to determine if certain program characteristics ^ 
which were highly correlated with greater gain scores for the low 
achieving children in this study and other studies, will actually 
effect greater achievement. Revisions in program planning and teaching 

^2- 



strategies might be implemented slowly and cautiously at the local 
levels with continued careful evaluation of the special efforts to test 

their effects for any given site. Study in natural field settings is 

/ 

necessary to test hypotheses such as those suggested by our data and to 
generate new hypotheses as other relevant variables become apparent* 
And we would suggest that data from these studies be analyzed to determine 
if any effect found is making a difference specifically for' the low- 
achievers* 

Another major effort should be made to determine the effectiveness 
of summer programs planned to include a substantial exposure to good books. 
The most . fundamental goal of the various research projects suggested ^ 
would be to improve our understanding of those things which positively 
affect reading achievement, particularly for the low achieving children. 
While we continue to pursue other ways to increase the general learning 
cf such students, we also must improve our techniques in teaching reading 
and maximize the use of the time' spent with th^m in that area. As a 
result of our research which led to several very strong hypotheses, we 
are convinced that discussions and interactions between experienced pro- 
fessionals in the field and a research team who can observe ongoing programs 
will reSv""*: in beneficial outcomes. We are also convinced that there is 
no panacea for improving reading on a nation-wide scale, but that with 
further research, certain factors may emerge as suggested components for 
effective reading programs which are tailored to the unique situation f^iind 
in every school. 
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APPENHTX A 



The following is a list of sites 

Sylacauga, Alabama 
Glendale y Arizona 
Tuscpn, Arizona 
Siprira Vista, Arizona 
/Flagstaff, Arizona 
Han ford, California 
Ne\7port Beach, California 
San Jose, California 
Westminster, Colorado 
Hartford, Connecticut (parochial) 
Fort Lauderdale, Florida 
Lewis ton, Idaho 
Wichita, Kansas 
Chicago, Illinois 
East St. Louis, Illinois 
Van Bureii, Maine 
Fall River, Massachusetts 
Leominste-^ Massachusetts 



which we gathered data. 

Andover, Massachusetts 

Clarkston, Michigan 

Minneapolis, Minnesota 

Lincoln, Nebraska 

Omaha, Nebraska 

East Brunswick,^ New Jersey 

New York City, New York (PS 140) 

Uniondale, New York 

Pinder County, North Carolina 

Cleveland, Ohio 

Aurora, Oregon 

Pittsburgh, Pennsylvania 

Newport, Rhode Island 

Portsmouth, Rhode Island 

Oglala, South Dakota 

Seattle, Washington 

Vancouver, Washington 

Stevens Point, Wisconsin 



^We would like to express our appreciation for the cooperation particularly 
from these communities, but also to other communities who responded to our 
questionnaire and indicated a willingness to participate. 
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Appendix B 
NIE # 



School Address : 

Tel. 

Administrator 

Study or Project_ ^ 



Author Date 

SCHOOL BACKGROUND QUESTIONNAIRE 



Please check answers that describe your school (s) during the year when this study 
was undertaken. (197 ) 

CHILDREN 

1. Grade levels served by your school (s) : 

K Gr.l Gr.2 Or. 3 Gr.4 Gr.5 Gr.6 Gr.6+ 
I£ school was nongraded, what age levels were included? 

5yrs. 6yrs. 7yrs. ,8yrs. 9yrs. lOyrs. llyrs. 12yrs. 12-^-yrs. 

2. Please indicate the number of pupils in your school(s) (i.e. the schools 
where thi? study was undertaken) . 

?. English was the first langu^^e of: * 

90Z or more of 50% or more less than 50% 

the students 



A. The socioeconomic status of most of the pupils was: 

primarily low SES low-middle middle^ 



middle-high primarily high 

5. The area served by your school (s) is: 

primarily rural primarily urban primarily suburban 

6. Which ethnic groups constituted 101 or more of your enroi^lment? 

Black Chicano Puerto Rican White/Anglo 

Other (note)^ ^ . 

INSTRUCTORS 

7. Were any types of special training, such as in-service workshops or seminars » 
available to the teachers (other than those given in conjunction with the 
study) 7 

O yes no Ott 



• 


* 

B-2 




8. 


Were teachers actively instnimental la curriculum development? 






yes no 


*> 


9. 


Did vour school then have teacher aides? ves no 




10. 


Did your school program Include tutors? yes no 




il. 


Was there a reading specialist (as defined by certification requirements In 






your state) assigned to your school(s)? yes no 




12. 


Were con^ altants from outside your school system or from the "central office" 






used throughout that year? yes no 




13. 


The assignment of students to classrooms that year was: 






heteroReneous heterogeneous for homogeneous for homogeneous 






most classes most classes 




lA. 


Select the phrase which best characterized classroom structure for the whole 






school. 






Children usually select materials and activities 






Children and teachers together aeree on materials and activities 






Teacher usuallv selects materials and directs activities 






Descriptive sentence 






r 




15. 


Organization of your school: 




- 


all classes graded most classes were most classes yere all classes were 






(i.e., K,1.2) single grades non-graded non-graded 




16. 


What was the averaee class size in vour school that year? \ 




17. 


Please indicate the number of hours per week spent by each child in reading 






instruction in the normal school progr^im: 






less than 1 3 to A. 9 10+ 


> 




1 to 1.9 5 to 6.9 






2 to 2.9 7.C to 9.9 




18. 


Which of the following were available to the children in your school? 






developmental reading proeram? learning disabilities program? / 






program of enrichment activities (films, tours, guest speakers, etc.)? 






remedial reading program? 






6786 










ERLC 







B-3 

SUPPORT SERVICES * 
19. Support was given to the parents via: 

general aeetings for all parents (including PTA, PTO, etc, 

home visits organised , ongoing committees or support groups 

parent-teacher conferences psychological services for parents 

social worker 



20. Which of the following were available to your pupils? 

vision and hearing screening 

other medical (note) , 



guidance or adjustment counselor social worker 

psychologist for severely disturbed children * 

FINANCING 

21, What was the per-pupil expenditure for your attendance area or district 

c?Mtiug 19 1 

22, was the source of your school funds: public? private? 

EVAUTATIQN 

23, Did >*ou have an achievement testing program for the entire school? 
yes D O 

vvhat tests were used? When? . For? 

(fall and/or spring) (grades) 



24, Did you keep records of children's performance on tests of intelligence or 
aptitude? yes no ; 

25, Would the project director ( ) be the person 

from whom to collect similar information on the children in his/her study 

or project study done in your school in 19 ? If yes, do you have 

his/her current address? . ^ 



68 




Study : 



Author : 



Address : 



Appendix C 
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Date; Tel: 

Questionnaire for Treatment and Control Groups 

Please check answers which best describe .he situation for your project. There is 
a separate questionnaire for each group and your answer on each questionnaire 
should pertain to one group only* Remember, your answers whould apply to the 
treatment situation, not the usual classroom* 

Group ' 

^^1. Major source of treatment: 

Classroom teacher Specialist Other tutor 

Machine Other (note) 

'children 

2* Grade levels participating: 

K gr 1 gr 2 gr 3 gr 4j gr 5 gr 6 gr 6+ 

If classes were nongraded for this study, what age levels were included? 

5 yr 6 yr 7 yr 8 yr 9 yr 10 yr 11 yr 

12 yr 12+ yr 

3* How many students were in the treatment group described in this 
questionnaire? 

4* Were children participating in this group identified as exceptional? 

Fd ' Yes . 

Were they identified as: gifted emotioually disturbed 

learning disabled mentally retarded other exceptional (note) 

5. English was the first language of: 

9P% or more of the students 50Z or more less than 50% 

6. The socioeconopiic status of r.ost of the pupils in this group was (Check one) 

primarily low SES low-middle middle ^ middle-high 

primarily high 

7. Which ethnic groups constituted 10% or more of the children in this group? 

Black Chicano Puerto kican White/Anglo^ 

Other (note) 
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INSTRUCTORS 

8. Under this project were any types of special training, such as in-service 
workshops or seminars, made available to the teachers of this group of 
pupils? No Yes (If "Yes*\ check as many as apply) 

Were they: voluntary compulsory specific to the program 

general completed before the program was underway 

ongoing during progra m 

9. Did teachers actively participate in developing curricului for this group 
of pupils? 

No Yes__ Did they: set objectives for program 

create learning materials 

10. Were aides participating with this group? No Yes 

Were they: volunteers paraprof essional secondary students 

college students student teachers parents « other adults 

11. Were the aides given any training for this program? No \es 

Was it: on a volunteer basis [ completed before program got underway^ 

ingoing during the duration of the program specific to program 

general 

(check as many as apply) 

12. Were there special tutors for your program for this group of pupils? 
No Yes 

Were they: volunteers ^ paraprof efesionals reading specialists 

elementary students (peer tutoring) secondary students 

college students parents other adults 

13. Were the tutors given any training under this program? No Yes 

Was the training: on a volunteer basis 

completed before program got underway 

ongoing during the duration of the progra m 
specific to program general 

14. Was there a certified reading specialist participating in the project? 
No Yes 

Did she: work with individuals grdiips of 2-6 groups larger 

than 6 function as a consultant perform diagnoses 



15. Were there any consultant ser>rices (other than the project director) 

brought in 8k>ecif ically for this project? No Yes 

Was their function to help with: management in-service training 

teachers in the classrooms students in the classroom 

other (note) . 



INSTRUCTION 

16. How were the chiloren selected to participate in the program? 

no selection, everyone participated low achievement SES_ 

random high achievement other (note)^ 

V. Was the assignment of students to groups: (select one phrase) 

heterogeneous heterogenaous for most groups 

homogeneous for most groups homogeneous individualized^^ 
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18. Select the one yhrase which best characterized classroom structure for this 
group: 

children usually select materials and activities 

children and teachers together agree on materials and activities 

teacher u sually selects materials and directs activities 

Please elaborate: [ ^ , , 



19. Wh/it was the organization of the groups? (Select one phrase) 

every group contained pupils from one grade level only i 

aost groups contained pjpils from one grade level only 

most groups contained pupils from several grade levels 

every group contained pupils from several grade levels 

20. Instruction of this group was carried m: 

in a school in a hospital in a church at home 

in a community center child care center 

rieading center (not in the school) other place (note) 

21. Please indicate the number of hours per week spent by each child in the 
reading instruction which was considered "treatment" under this program, 
hours per week 

Were these hours in addition to children's regular instruction? No Yes 1 

Were they a substitute for his regular instruction? No Yes 

22. Please indicate the number of hours per week each child participated in a 
- special "treatment," other than reading, under this project. 

hours per week ' 

Were these hours in addition to children's regular instruction? No Yes 

Were they a substitute for his regular instruction? No Yes 

« 

23. What size groups were formed for reading (or other treatment)? 

individuals 2-5 pupils ^-KT pupils 10-20 

more than 20 mix dr other group sizes (note)^ 

24. How would you describe the natute of "treatment" given to this group? 
major focus was^ developmental reading remedial reading 

an enrichment program (films, tours, speakers, etc.) 

other (ncte)_ , ^ 

25. Indicate with check marks in the appropriate columns whether the materials 
used for reading and/or language instruction for this group included major, 
qiinor, or no emphasis on the following: 

Maj or Minor None 

decoding [ 

comprehension 

study skills 

speed reading ^. 

writing 

language arts 
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26. How long were the children in fhe treatment group? 

27. Did parents participate in the program? No Yes 

They helped: as library aides in the design and development of 

curriculu m - in planning and implementing the program 

SUPPORT SERVICES 

28. Was additional suppt t provided to the parents under this project? 
No Yes 

Were there: general meetings for all parents home visits 

parent-teacher c 'ferences 

organized, ongol-^. ^.>mmittees or support groups social worker 

psychological set • sis for parent <i 

training programs ;>r parents on working with own children 

other (note) 

29. Were any of the following ^xtra services provided for the child under 
this program? No Yes Services provided were: 

meclical (note) guidance or adjustment counselling^ 

social worker psychologist for severely disturbed children 

other (note) 



FINANCING 

30. What was the per-pupil expenditure for this program? ^ 

If not kno%;»,what was the total cost of the program? 

31. What was the source of funding? 

I 

EVALUATION 

32. Which tests were used in pre- land post-testing students in this group? When? 



33. Did you keep other data? 

observational records affective measures ; language development 

neurophysiological development aptitude or intelligence datt. 

3A« Uow was pupil progress zeoorted? 

teacher-child conference teacher-parent conference 

teachiar^child-parent conference written reports 
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APPENDIX D 
NIE Coding Sheet - School Variables 



Column j? 

1 Studv ID 

2 

3 » 



number of sets of xards for study (tst least 2) ^ 

school ID: 0 = treatment card 1 = ? 2 = (refer back to s.tudy for coding used) 
treatment ID; -0 = scnool card 1 = ? 2 » (refer back to study for coding used; 



7 

8 

Children in school 



9 


grade k 


0 = NA 


1 




9 


2 = N 


3 = y 








10 


1 


U = MA 


1 




9 


2 = fJ 


3 = Y 






lion graded) 


11 




U = WA 


1 




7 


2 = W 


3 = Y 




(estimate for 


12 


3 


U = NA 


1 




9 


2 = 


3 = Y 








13 


4 


0 « NA 


1 




9 


2 - N 


3 = Y 




# 




14 


i) 


0 = tih 


1 




9 


2 = kJ 


3 = Y 








15 


e 


0 = AIA 


1 




9 


2 - W 


3 = Y 








16 


0+ 


U = NA 


1 




9 


2 = aI 


3 =■ Y 








17 


number of students 




1 


= ? 2 


= 1-4^ 3 = 50- 


-90 


4 = 100-199 5 


= 200-299 




£ =■ 


300-499 


7 




500-999 


8 = 1000-4999 


9 =■ 


5000+ 





18 exceptioi^al ch.^racteristics. 1 ^ V 2 «= N 3 •= exceptional (LD, MR, etc.) 
i. = gifted 5_ r^niix 

le Lnglish as first language. i=? 2 = w 3 =^ i !lT.JJ^}^ - 
Socio-economic status_ and^ enviro nment 

20 low: 1 = ? 2 = ti 3 = Y 

o 

21 middle. 1=? 2=1^ 3 = low-middle 4 = Y 5 = hiBh-middle 

22 Iiigh: 1«? 2 = U 3«Y 

^/ 

23 school district: 1 = ? 3 = urban A = rural 5 = suburban b = town 7 « mix 

24 etlmicicv. 1 = ? 2 = American Indian 3 = fil^ck. A « Wliite t> = Spanish 
speaking or surname 6 = Black and White 7 = Spanish and \/Jhite 8 otner 
9 = otner nix (90% is considered all one group) 

ins t rue tor var i^ablcs 

25 teacher training. 1=? 2«N 3 = present 

26 teacher curriculum development. 1=? 2 ^ ^ 3* present 

« 

27 teacher aides: 1 = ? 2 = W 3 = present 
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In struc to r variables (c ont) 

3D tutors: 1«? 2*N 3» present , 

34 reading specialist: 1«? 2«N 3« present / 

35 ex-project consultant; 1«? 2»iJ 3» present 
Instruction 

37 grouping. 1 « ? 3 « heterogeneous 4 « homogeneous ^ « individualized <>^r.]!lA?. 

38 structure. 1 « ^ 3 « child determined 4 » teachec determined 3 « cuild plus 

teaclier 0 « combination 7 « other 

40 graded: 1 « ? 3 « graded 4 » ungraded (or multi-graded) mix_ 

41 class size; 1 = ? 3-1 4 » 2-e; 5 « 7-15 6 « lb-30 7 « iOf 
Time. . 

•• \ " • 

42 . hours spent in reading instruction: 1«? 2«N 3* less^than 1 hr./wK. 

4 » 1-1. y hr./wk. 3 « 2-2.9 hr. 6 « 3-4.9 7 » 5-6.9 6 » 7-9'.^ 9 » 10 hr^s.+ 

Prograti^ Q^ arac tcristics 
tJ^ure 

46 developmental reading: l«?2«|j3«Y 

47 remedial reading: l=«?2«(\i3«Y 

48 enrichment. 1=«?2«.^3«Y 

49 other treatments; l«?2«^iO«Y 

Pa rent support 

59 ^parent groups: 1»'?2«K3«Y 

60 psychological .^services: la?2«hl3'f^Y 

61 social worker. 2=«ii 3«Y 

62 ' ^ 

Su ppo rt ser vices to child \ J . 

63 medical: 1»? 2«if 3« a?^sumed 4 « Y . 5 « beyond normal ^ 

64 guidance counselor: 1«? 2»N 3» assumed 4 « Y 5 « beyond normal 

65 social worker; 1«? 2*^ 3« assumed 4 « Y 5 » beyond normal 

66 psychologist: 1«? 2 = N 3 - assumed 4 * Y '5 « beyond normal* 

b7 learning disabilities specialist* JL«? 2»(J 3« assumed 4 « Y 5 « 

beyond normal / / 

93 / . . 
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Finances 

68 per pupil expenditure: 01 » ? 02 » ti 03 - 1-99 OA - 100-199 05 - 2U0-299 
and 06 = 300-395^ 07 « 400-A99 08 = 500-399 09 » 000-699 10 « 700-799 

69 11 « 800-899 12 « 900-999 13 « IOOO+ 

70 source oi funding: 0«NA-1«? 2 = ^vblic 3 = private 4 » puMic and private 

other 

Eva 1 nci I lon^ o f s tudents 

71 Anchor Tests, pre-* and post-: 1 = ? 2 » California Achievement Test (1970) 

3 = Ccnpreiicnsivc Test of basic Skills (1968) 

4 = Cates-MacGi.iitic keadinf. Tests (1964) 

5 = Iowa Tests of Basic Skills (1971) 

6 = Metropolitan Acbievemtiar Tests (1970/ 

7 S€^quentifl Tests of Educational Progress II U969) 

8 = SKA Achievement (19 71) / 

9 - Stanford Achievement (19b4) * 
0 = l4on--Anchor 

72 Standardized tests, p':*^- r..iu post-: (special codes 01 - 99; 
and 01 - ? 

73 02 = Test c£ fiasic Experiences 

03 = Metropo) itan Reading Readinciss 

04 • California Cooperative 

' 05 = Gray 0ral( 

00 - Gilmore 
|07 ~ Slosson 
= Other 

7^ . , 

7b Aptitude and/or intellij;enco- data. 1«?2^=U:>'=Y 

76 Other luensures; 1 = ? 2 = N 2^ Y 

77 Progress :-cportinp. 1 = ?' 2 = N 3 =« teacher child conferences A - teacher 

parent conferences 5 = tea^cuer cnile-pardnt conferences 6 * written 

78 

79 ^ / ' . 

80 Card number 1 \ 
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NI E Cod ing _Sho ct for Tr eatment Variables 

Co 1 utttn » 

1 Stu'ly 10 

2 •* 

2^ . ti / 



4' number of sets of cards for study (at least 2) 

S*" school ID; 0 = treatment card 1 = ? 2 » (code refers back to specific school) 

treatment ID: 0 « school card 1 « ? 2 = (code refers back tq, specific treatment 

\ ' ' number) 

7 6^ major sorrce of treatment. 0 = NA i«? 2 * ti 3«* classroom teacher 
A = specialist 5 = tutor 0 « machine 7 « teacher speciaiiot 
8 = regular teacher + specialist 9 = teacher + tutor 10 » tcadner + macliine 
11 « specialist + tutor 12 = specialist + machine 13 « tiitor + macliiuc 

« 

Cii ildr^n^ in stud y 



9 


Grade 


K. 


0 = UA 


]0 




1. 


• 0 = MA 


11 




2. 


0 = ^iA 


12 




3 . > 


0^= hJrt 


13 




A. 


0 = 


14 






0'= .\A 


15 




6: • 


0 = ..A 


10 




6+' 


0 = ..A 


17 




r of 


students . 




6 


= 500-499 7 



"2 »" 


'a' 


"T 


r=» Y 






2 = 


a 


3 


= .r 






2 = 




3 


= V 






2 =« 


u 


3 


= Y 






2 = 


t( 


3 


" Y 


(estimate 


for ungraded) 


2 = 


■bi 


3 


= V 




2 = 




3 


= Y 






2 - 


ti 


• 3 


= 1- 






-49 


3 


= 50- 


-99 4 


= 100-199 


5 = 200-299 



1 = >■ 

1 = ? 
1 = ? 
1 = ? 
1 = ? 
I = ? 

/ 

50g-999 8 = 1000-4999 9 = 5000+ / 

18 Exceptioha.l chnVactcristics. 1=? 2«K) 3 = exceptional (ED, I'-k, etc.; / 

4 = hi f ted 5_f_mix / 

19 English firs,t language. 1 f_? 2_'=_ N 3 » Y 4 - Mix , ^ / 

I 
I 

SES 

20 Low: rl-?2-N3-Y * '/ 

21 Middle:. iX - T 2 » N 3 - low-middle 4 - y 5 - high-middle 

22 High: 1-72-N3-Y 



r 
t 

23 School dijStrict: 1 - ? 3 - urban 4 - rural 5 - suburban 6 - town 7 ■ mix 



24 Ethnicity^: 1 - ? 2 - American Indian 3 - Black 4 - White 5 - Spanish 
speaking or surname (Puerto Rican & Chicano) 5 - Bla^ck & White 

Spanish & White 8 - Qthyr (Portuguese, Polish, French), 9 - Other mix 
(902 shall be considered all ' one grd^ / 

■ 7 . • ' 



7 
( 

Instructor Vai. ialblea 



25 Teacher training: 1-? 2«N 3 - during program (specific) 74 - during 
program (general) 5 * completed training (specific) 6 - completed 
trailning (general) 7 « pre-program and during (specific) / 8 « pre-program 
and kiuring (general) / . . 

26? Teachej: curriculum developmant: 1-? 2-N 3 - present - objectives 
t pnlyi 5 - learning activities only 6 - combination / 

' ' ' ■ / * / 

I 27 Ttacher Aldcsi 1-? 2-N 3-« present and unknown 4 - /volunteer 
^ 5 - pi^raprofessional 6 - mix 



E-2 

Coluinn^f 

28 Teacher Aides. 1«? 2«M 3=* elementary ,4 = secondary 5 « college / 
^-6 = student teacher 7 « pareots S » o^her adults ^_^^jnix 

Z\) • Aides* training, for program: V = ^it\ 1 - ? 2 - I< 3 present and unkn/)Wu 

4 » during program (specific) during program (general; 6 » pre-program 

(specific) 7 - prc-program (general) 8 f pre , and during, specific 
- 9 « pre and during, general . " • 

JU Tutors. ^l«?.2«i\ 3» present 4 * volunteer 5 « paraprofessionals 

fa « reading specialist 7 = machine 8 =' Learning Disability tutor iL ^ Pi^ 

31 Tutors. 1 =, ? 2 - ^ 3 = elementary 4 = secondary j - college o = par^iats 
. . .7-«^5tiier adults 8 = professional mix 



32 Tutors' training for prbgrdm; 0 = N'A 1 2 « >J 3 = present 4 = during 

urogram, specific 5" = during program (general) 6 « pre-program (specific; 
7 = pre-program Cgeueral; 6 ~ pre and during, specific 9 ^ pre and 



33 



during, general ^ ' ^ 

' rl^adinp Specialist: 1 = ? 2 = W 3 = works with individuals only 4 = works 
I \ witti individuals and small (-2-6) groups 5 = works vJitii inUividiuils and 
( 1 small groups and large groups 0 « works with individuals and dar>;o groups 
M', 1 ~ works with small groups and large groups 8 = works with small groups 
only ^ ~ works with large groups only 



34 Reading Specialist as Diagnostician: 1=? 2=N 4= diagnosis onlv 

5 = consultant only fa = diagnosis a:id consultant 

/ 

35 Project Director services: 1-? 2-N 4- management 5 - in-service 

training 6 ■ work with teachers in classrooms 7 ■ worU with students* * 
in classrooms 8 ■ other 9 ■ mix ^ 

36 Projisct consultant services: 1«? 2«N 4« management 5 - ia-service 

training 6 ■ work with teachers in classrooms. 7 « work with students 
in classrooms 8 ■ other 9 ■ mix . 

Instruction * ^ 

37 Seiecti of S£ for program: 0-NA i«? 2«ri selection or everybody 

3 low achievement 4 « SE3 5 ■ random 6 -Xhigh achi'*^ ent 7 ■ other 

38 Grouping: 0, ■ NA 1 ■ ? 3 ■ heterogeneous 4 - homogeneous [grouping by*^skill 

deficit, not age] 5 ^ individualized 6-3+5 7-4+5 8-3+4 

39 Structure: 1 - ? 2 - child determined .3^ - teacher determined (includes 

child's choice after teacher's determination) 4 - child plus teacher 

5 - combination other (includes teacher directed with free choice element) 

6 - other 

40 Graded: 0-NA 1-? 3- graded 4 - ungraded (or multi-grade) 5 » mix 

41 Treatment grp/slze: 1-? 3-1 4- 2-6 5 - 7-15 6 « 16-30 7 - 30+ 
Location 

42 1 - ? *2 - in school classroom 3 - inschool-lab or resource room 4 « church/ 

community center 5 - hospital 6 - child care center 7-- reading center 
8 - home 9 - other I 
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Tiae % 

A3 Hours spent in reading instruction: 1-? 2-. N 3 - less than 1 hr, per wk. 

4 - 1-1,9 hrs, per wk. 5 - 2-2.9 hrs. per wk. 6 - 3-4.9 7 - 5-6.9 

8 - 7-9.9 9-10 hrs. per week or more 

ir 

44 Hours spent in ''treatment" other than reading: I'-? 2-N 3 - less than 

1 hr. per wk. 4 - 1-1.9 hrs. /2k. 5 - 2-2.9 hrs. /2k. 6 - 3-4.9 
7 - 5-6.9 8 - 7-9.9 9 - lOf 

45 Treatment hours: 1-? 2-N 3- substitute for regular program 

4 - base plus increment 

46 Grouping for reading and /or other treatment: 1-? 2-N 3-1:1 4- 1:2-1:5 

5 - 1:6-1:10 6 - 1:10+ 7-3+4 8 - 3 + any other 9 - other mix 

Characteristics of program 
' Nature: 

47 Developmental reading: 1 - ? 2 « none 3 - available 4 - minor 5 - major 

48 Remedial reading: X " ? 2 - none 3 ^ available 4 - minor 5 - major 

49 Enrichment: 1 - ? 2 - none 3 - available 4 - minor 5 - major 

50 Other treatments ; 1 » ? 2 - none 3 - available 4 - minor 5 - major » 

Materials en^pUasiii; 

51 Docodinj*: 1=? 2=N 3 = rr.inor A = emphasized 5 « assumed 6 = phonics 

52 Compreiieasiou: i=? 2=N 3 = minor A = emphasized assumed t = vocab. 

7 = A + 6 

5 3 , Study .skills: 1=? 2 - U 3 = minor A = emphasized 5 ^ assumed 
5A Speed; 1 = ? 2 = ll 3 = minor A = emphasized 5_=_assum^ 

55 Writing. 1=? 2 = |J 3 = minor A = emphasized 5 = as sumed 

56 Language Arts. 1=? 2«(i 3 = minor A empnasized 6 = assunied^ 

Pa rea t_ Part i c ipa t ion 

57 Active in program: 1 = ? 2 - ii 3 = Y (Code under #L)9 for nou-participatinj; 

Parent Advisory Committee,) 

38 

Support Services * 
'5^ Parent proups: 1=? 2=li 3 = Parent Advisory Council A » general meetings 

'5 = 3 + A 6 =• organized support groups 7 « home visits ^ * combinations 

oti^cr than J?5 

60 

ol Psycnolojiical services: i=? 2=N 3 = Y 
6J S'oc;ial worher: i=?2«K3=Y 
•^PP^^i. services to cliild 

63 Medical: 1=? 2=W 3= yes, beyond school's regular services 

oA Guidance Counsirlor: 1=? 2 = N 3-=Y, beyond school's regular services 

65 Social worker. 1=? 2=N i=Y, beyond school's regular services 

66 Psycholoj;ist: 1 ~ ? 2^1^ 3 = Y, beyond school's regular services 



67 
68 

69 



9? 
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70 Source of funding: 0 » 1 « ? 2 « Title I 3 « Title III A « public 

5 « private 6 « public and private 7 « Follow Xhrougli 8 » other or mix 

evaluation of students 

71 Anchor Tests, pre- and post-: 1 » ? 2 « California Achievement Test (1970) 

3 Comprehensive Test of Laslc Skills (1968) 

4 » Gates-MacGlnUie Reading Tests (1964) 
^ 5 = Iowa Tests of Lasic Skills (1971) 

6 * Metropolitan Achievement Tests (197U) 

7 = Sequential Tests of Educational Progress II (1969) 

8 SRA Achievement (1971) 

9 « Stanford Achievement (1964) 
0 = I>ion-Anchor 

72 Standardized tests, pre- and post-: (special codes 01 - 99) 
& * 01 « ? 

73 02 " Tests of Basic Lxperiences 

03 = Metropolitan Heading Readiness 

04 « California Cooperative 
03 = Gray Oral 

06 = Gilniore 

07 = Slosson 

08 » Other 

74 Observational data: 1=? 2 = iJ 2=Y 
7d Aptitude and/or intelligence data* 1=? 2=W 3«Y 
7b Other measures; 1 = ? 2 = 3 » Y 

77 Progress reporting. 1=*? 2«^i 3» teacher-child conferences 

parent conferences 3 - teacner-child-parent conferences o 
7 = * combin a t J. o n 

General I nformat ion 

78 Research design: 

0 = NA 1 = ? 

2 =» one group, pre- and post- test 

3 - comparison group and treatment group, pre- aud post-test 

4 - random assignment of treatment to intact groups, pre- and post-test 
3 « time series (longitudinal study) 

6 « random assignment of subjects to treatment & control groups, pre- and post-test 

79 Bibliographic source: 1 « ? 3 « journal article 4 « project report 

5 « doctoral dissertation 6 « masters thesis 7 • paper 

80 Card number 2 

[If possible, note somewhere why Project Director feels the program Ww^s a success 
(or not) ] 



4 » teacaer- 
= written 
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Scores L^^isir.r.atir.jj Lew-, MiJ-, Hign Groups^ 
Cut-off Points used to Fom Clusters of Low-, Mid-, and High Croups at Each Grade Level 



Previous 



Grade Test 

1 Gates McGiriitie 
>Ietro?olitxkn* 

2 California Achievcner^t 
Gates McCinitlc 

Metropolitan 

Stanford 

3 California 
Gates McCinitie 



Metropolitan 

(children protested 
Stanford 

Motropolitun 

Metropolitan 



Level 
and 



Fall Cut-Off Scores Spring Cut-Off Scores 
for 

Low Croup Hich Group Low Croup High Croup 



Metropolixan 



Prirary A Conprehension 

Primnry I Comprehension 

Priner (converted to Prinnry I) 

lA Totnl Score 

Prisinr/ B Conprehcnsion 

Prinary A (converted to B) Total Score 

Pri'T.nry II, Total Score 

Prir.ary I (converted to II) 

Pri-:ary II, Total Score 

Pri-.ary I (converted to II) 

2A, Totnl Score 

Prinnry C, Conpreheusion 

Pri'-ary li (converced to C) 

Prinary C, Total Score 

Prinary 3 (cp^^vcrted to C) • 

hlcr.cntary, Total Score 

Prir.arv II (converted to Mlerontary) 
rrirnry I (converted to Llerentary) 
at beqir.ning .^f crnde 2) Total Score 

Prinary II, Ccrtprehension 

Total Score 
nic-.entary F, Cor.prchension 

Total Scor« 
Ir.terradiate F, Conpreher.sion 
nie-entary (converted to Intcrr.ediate) 
Inter-.ediate F, Total Score 
r.lun^ntnry (converted to Interr.ediate) 
Intermediate F, Ccr.prehension 

Totnl Score 



7 
3 

59 
7 

21 

17 

33- 
12 

30 

26 

13 
2A 

38 
15 
3A 



26 

lA 
33 



20 
12 

lOA 
24 ' 

69 ' 

&6 

78 
37 

76 

66 

41 
47 
76 
37 
82 
34 

71 

39 / 
81 



9 

15 
13 

15 
32 
21 

20 
32 
13 
29 

11 



14 
32 



12 

24 
44 
37 

30 
75 
52 

43 
7C 
34 
76 

32 

67 
36 
77 



These scores represent n .-ut-oft ocore for tliC low group at the 16th percentile; for the nid ^roup, fron the x7th 
to the 34th percentile; and for J.]ie iiis^h ?;roup, above the 8^*th percentile. 

*Lnd of Kindergarten r.orr.s used; :.o percentile ranks given for beginning of grade 1 in iiAT Prirary I or PriJrier. 
The Kindergarten percentiles on Prir.or were con'-erted to Prinary I, 

**Tr.e Gates provides r.o total scor^ . nnd therefore no percentiles for total scores. We arbitrr.rily devised cut- 
off points for the 16th and dAth percentiles by cor.bininp vocabulary and comprehension scores. 
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APPENDIX F 

TA15LE F J- 2 

CLUSTERING GROUPS BY PRE-TKST 

Sample Size (N) Means (X)- and Standard Deviation (SD) for the 
Low, Medium, and High Groups in Grades A, 5 and 6 Formed on the liasis of Pre-'fest Scores 





• 




Vocabulary 






Comprehension 




Total 




Grade 




N 


X 


SD 


JL 


X 


SD 


N 


X 


SD 




LOW 


414 


i2.367 


5.462 


414 


8.860 


5.130 


430 


21.247 


8.187 




MID 


293 


30.863 


8.131 


293 


22.065 


7.969 


302 


52.692 


13.936 




HIGH 


52 


46.269 


2.643 


52 


39.385 


2.277. 


52 


85.654 


3.662 


5 


LOW 


295 


11.068 


3.505 


295 


8.675 


3.405 


306 


19.768 


5.326 




KID 


337 


21.715 


7.138 


337 


17.5^0 


6.516 


513 


42.433 


12.623 




HIGH 


23 


42.609 


3.615 


23 


37.00b' 

\ 


' 3.568 


106 


76.132 


6.400 

« 


6 


LOW 


243 


13.811 


3.994 


243 


11.140 


3.458 


250 


# 

24.976 


5.827 




MID 


433 


26.972 


7.401 


433 


22.986 


7.282 


601 


53.118 


13.243 
4.078 




HIGil 


38 


45.526 


1.704 


38 


38.658 


1.192 


'" 125 


83.664 
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APPENDIX G 
TRANSFORMATION OF NOMINAL VARIABLES 

Our Qomiaal variables (those for which ao assumptions could be made about orderlim 
the categories) had to be transformed ii> order to determine their correlations with 
gain scores* A set of contrasts between the response categories (or dummyj^ariables) 
were created for each variable. The correlations of each of these contrasts with 
gain scores was then combined and a multiple correlation for the original variable 
vith gain scores computed* & 

For instance, for one group (#20) the variable on Consultant Services for the 
reading program had responses in four categories: 2, 5, 8 and 9 as described below. 
We had no rationale for ordering these categories (i.e., for saying 9 was better than 8 
which was better than 5 etc.), much less giving them a numerical value. So, orthogonal 
contrasts were set up with the assigned values given in the table to determine the cor- 
relation of the set of contrasts with gain scores. The assigned values for the ortho- 
gonal contrasts or dummy variables and the correlations with gain scores were as follows 



5 8 



simple correlation 
for each contrast 



multiple correlation 
for three contrasts 
together or 
the original 
variable 



Dummy variable 
or contrast-1 

Dursmy variable 
or contra8t-2 



Dunmy variable 
or contra8t-3 



0 1-1 



2 -1 -1 



-1 -1 -1 



.271 



-.196 



.022 



.406 



ERIC 



2-no consultants 

5-cdnsultant for inservice training only 

8- consultant for "other" service (evaluation or program design) 

9- con8ultant for some combination of management, training, evaluation, work with 
teachers,- etc. 

The multiple correlation of these contrasts represents the relationship between 
the gain score and a combination of the dummy variables. The coefficient of 
.406 represents the correlation between the nominal variable, TCONSULT and gain 

82 101 



G-2 

•corM. 

The particular orthogonal contrasts In .the duHiy variables Is arbitrary » but 
their total contribution to the multiple correlation with gain scores is the saM / 
no matter what contrasts are chosen. 

Correlations of all nominal variables were computed to yield the simple correla- 
tions of each contrast within the variable. Then, based on the strength of the corre- 
lations of the contrasts with gain scores, a subset of variables was selected and ^ 
multiple correlations computed for them. Time and budget constraints prohibited us 
from computing multiple correlations for all nominal variables. Table 8 presents the 
significant multiple correlations computed; multiple because they combine the set of 
contrasts within each variable. 
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. , SES VALUES 


.-y 'l 

- - - , --, -}_S 




Conposltloa of SES Values 1 to 10 from Questionnaire Responses. 


- i 


' ' - . -/ ' 


Value 
■ Coded 

1 


Soclo-^economlc Groups Repftesented 
All children from low SES; backgro%d8 




- y _J " _ " 


2 


Children from low and; loWrniid^^^ SES 




^^'^r-'' - _ __' 

> ' -" - - 

# - -_- ^ -- -_ \- 
^ --z~ * ^ ' " t " 

it . " 


3 
4 

{- 5 
6 


Aii cAll^dreh ffoft Igw-itdddle^ S^^ 
Children from low and from middle SES 
All children from middle SK 
Children from low and highridddle SES 




.1" __ " _ ______ 




from Id^, iowrmiddiei^^^ 
f romr^low^mfddle, ahd^ 






7 


from Icwi hith-middlei arid hi^^ SES 
. from low-raiddic andrhigh SES 

Children from middle and from high SES 


- _ ' ,4 




8 


All children from high-ndddle^S^ 






- 

10 


^ — Children from high-middle and from high SES 
All children from high SES 

0 




^ - _ ' _ 




t • 
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APPENDIX I 
Tests Used at the* Various Sites 



Califorala Achievement Test (CAT) Monterey, California: California Test 
- ;^ureau, 1970. * . 

~ Cbmpf ehenslve- tests of' Basic Skills <CTBS) Monterey, California: California 

/TTesrlB^ 

Ga t e S'^Mc G in 1 1 i e (GM) New York: Teachers College Press, Columbia University, 
" 1964. - - 

tova-Everv Pupil Tests of Basic Skills (ITBS) Boston, Mass.: Houjhton Mifflih,, 

Metropoiitah Achievement test . (MAT) New York: |iar court. Brace & World, lS|7Ct. 

Sequent iai ^ of Educational Progress (STEP) Princeton^ Ne^Jersey: 

rEdiicational Te Service, 1969. 

Stanford Achievement (SAT) New York: Harcourt, Brace & Wcj/ld, 1964. 
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